-- Logs begin at Tue 2022-09-13 19:05:10 UTC, end at Tue 2022-09-13 20:40:09 UTC. -- Sep 13 19:40:23.032056 dv-cinder-828805-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 19:40:23.039226 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:40:23 2022] *** Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: nodename: dv-cinder-828805-6-iscsi Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: machine: x86_64 Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: clock source: unix Sep 13 19:40:23.041201 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: pcre jit disabled Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: detected number of CPU cores: 4 Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: current working directory: / Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: your processes number limit is 47680 Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: your memory page size is 4096 bytes Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: detected max file descriptor number: 2048 Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: lock engine: pthread robust mutexes Sep 13 19:40:23.042327 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: thunder lock: enabled Sep 13 19:40:23.053599 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 19:40:23.053599 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:40:23.081737 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: Python main interpreter initialized at 0x55ecc00959c0 Sep 13 19:40:23.081737 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: python threads support enabled Sep 13 19:40:23.081737 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: your server socket listen backlog is limited to 100 connections Sep 13 19:40:23.081737 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:40:23.082067 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:40:23.082194 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: *** Operational MODE: preforking *** Sep 13 19:40:23.082455 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:40:23.082455 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: spawned uWSGI master process (pid: 112485) Sep 13 19:40:23.082664 dv-cinder-828805-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 19:40:23.083221 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: spawned uWSGI worker 1 (pid: 112486, cores: 1) Sep 13 19:40:23.083555 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: spawned uWSGI worker 2 (pid: 112487, cores: 1) Sep 13 19:40:23.083704 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:40:23.733980 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:40:23.735159 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:40:24.822606 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:24.822606 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: from cryptography.utils import int_from_bytes Sep 13 19:40:24.823769 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:24.823769 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: from cryptography.utils import int_from_bytes Sep 13 19:40:24.831035 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:24.831035 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: from cryptography.utils import int_from_bytes Sep 13 19:40:24.831486 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:40:24.831486 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: from cryptography.utils import int_from_bytes Sep 13 19:40:27.288440 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:40:27.289073 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:40:27.289444 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:40:27.289535 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:40:27.289639 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:40:27.289749 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:40:27.289833 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:40:27.289922 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:40:27.290004 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:40:27.290095 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:40:27.290177 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.290266 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.290427 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.290549 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.290748 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.290874 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.291072 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.291199 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.291925 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292175 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292287 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292385 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292536 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292645 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292856 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.292953 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.293184 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.293290 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.293443 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.293550 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.293781 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.293889 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.294103 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-6-iscsi {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.294200 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-6-iscsi {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.294427 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.294516 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.294736 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.294823 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295049 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295146 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295370 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295480 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295675 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295772 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.295994 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.296082 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.296300 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.296401 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.296799 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.296917 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.297973 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298081 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298160 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298228 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298228 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298363 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298363 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298488 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298553 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298616 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298809 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.298952 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.299075 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.299206 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.299388 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.299516 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.299710 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.299839 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.300021 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.300148 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.300446 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-6-iscsi {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.300586 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-6-iscsi {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.300714 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.300838 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.301035 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.301194 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.301345 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.301464 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.301779 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.301945 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.302090 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.302205 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.302400 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.302536 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.302701 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.302832 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303023 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303159 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303332 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303474 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303657 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303788 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.303977 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.304110 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.304292 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.304429 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.304609 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.304744 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.304909 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.305037 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.305217 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.305358 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.305521 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.305682 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.305872 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306001 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306176 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306334 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306463 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306595 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306721 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.306873 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.307574 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.307825 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.307966 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308093 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308237 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308372 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308511 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308640 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308776 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.308904 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309031 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309166 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309300 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309426 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309560 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309719 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309865 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.309992 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.310180 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.310317 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.310488 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.310617 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.310793 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.310924 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.311099 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.311236 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.311402 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.311530 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.311708 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.311848 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312013 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312141 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312330 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312487 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312628 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312761 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.312950 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.313077 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.313257 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.313393 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.313576 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.313767 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.314240 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.314381 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.314518 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.314652 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.314779 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.314903 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.315118 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.315248 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.315434 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.315571 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.315742 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.315876 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316058 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316186 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316378 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316515 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316683 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316811 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.316990 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.317117 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.317295 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.317432 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.317635 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.317766 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.317967 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318269 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318397 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318524 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318655 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318810 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.318939 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.319114 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.319243 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.319432 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.319575 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.319737 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.319867 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320042 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320171 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320345 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320473 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320646 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320774 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.320954 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.321082 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.321259 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.321386 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.321562 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.321716 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.321920 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322047 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322171 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322295 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322501 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322645 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322810 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.322939 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.323116 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.323254 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.323504 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.323639 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.323775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.323901 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324027 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324151 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324321 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324462 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324629 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324759 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.324934 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.325075 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.325237 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.325374 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.325542 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.325711 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.325888 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326015 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326194 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326335 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326498 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326637 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326814 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.326944 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.327120 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.327256 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.327422 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.327549 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.327738 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.327866 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328043 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328179 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328347 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328476 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328664 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328799 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.328963 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.329102 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.329270 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.329398 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.329582 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.329727 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.329911 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330050 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330216 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330344 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330518 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330646 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330820 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.330949 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.331124 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.331251 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.331426 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.331560 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.331727 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.331868 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332029 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332166 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332326 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332454 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332641 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332789 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.332957 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.333086 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.333263 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.333400 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.333569 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.333735 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.333898 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.334031 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.334217 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.334358 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:40:27.334549 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.334677 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.334880 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335008 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335216 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335357 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335529 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335657 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335861 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.335989 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.336186 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.336323 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.336501 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.336631 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.336815 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.336938 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.337125 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.337253 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.337449 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.337578 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.337783 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.337914 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.338608 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.338754 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339026 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339163 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339289 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339443 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339591 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339716 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.339871 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340000 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340186 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340315 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340503 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340631 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340817 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.340944 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.341131 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.341257 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.341445 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.341574 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.341797 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.341937 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.342115 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.342244 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.342425 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.342563 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.342765 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.342893 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.343103 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.343308 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.343438 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.343571 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.343724 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.343854 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344043 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344188 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344353 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344485 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344661 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344791 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.344969 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.345108 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.345307 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.345437 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.345667 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.345813 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.345945 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346078 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346247 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346377 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346554 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346674 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346876 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.346997 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.347184 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.347312 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.347493 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.347621 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.347801 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.347931 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.348109 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.348246 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.348416 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.348546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.348746 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.348886 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.349060 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.349187 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.349379 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.349506 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.349716 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.349853 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350028 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350163 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350345 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350481 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350652 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350787 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.350963 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351092 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351271 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351422 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351583 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351709 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351864 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.351992 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.352170 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.352306 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.352477 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.352605 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.352780 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.352907 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.353095 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.353235 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.353419 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.353546 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.353752 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.354404 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.354655 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.354807 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.354941 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355067 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355201 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355326 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355499 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355629 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355810 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.355939 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.356114 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.356244 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.356424 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.356553 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.356733 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.356865 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357037 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357164 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357355 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357484 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357687 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357828 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.357995 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.358123 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.358316 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.358455 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.358621 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.358749 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.358924 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359065 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359235 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359364 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359672 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359854 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.359989 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.360166 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.360300 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.360472 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.360599 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.360793 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.360932 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.361106 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.361246 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.361412 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.361540 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.361767 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.361897 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.362095 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.362223 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.362401 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.362531 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.362724 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.362846 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363046 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363168 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363362 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363490 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363662 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363791 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.363968 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.364098 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.364270 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.364400 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.364570 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.364699 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.364903 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365036 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365169 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365302 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365463 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365591 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365788 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.365918 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.366086 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.366223 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.366385 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.366515 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.366684 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.366822 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367001 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367144 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367307 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367435 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367605 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367744 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.367904 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368042 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368203 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368339 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368541 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368670 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368843 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.368971 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.369179 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.369319 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.369548 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.369734 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.369882 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370008 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370272 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370408 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370534 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370659 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370818 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.370950 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.371132 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.371259 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.371440 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.371567 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.371750 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.371889 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372061 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372191 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372377 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372505 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372707 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372833 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.372993 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.373123 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.373300 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.373441 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.373638 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.373771 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.373952 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.374084 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.374272 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.374410 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.374578 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.374714 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.374892 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.375020 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.375230 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.375367 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.375559 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.375688 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.375874 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376014 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376195 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376332 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376506 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376634 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376818 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.376946 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.377128 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.377264 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.377438 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.377574 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.377770 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.377899 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.378078 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.378213 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.378394 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.378531 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.378704 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.378831 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379018 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379146 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379463 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379649 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379777 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.379956 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.380091 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.380275 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.380412 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.380579 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.380706 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.380894 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381030 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381219 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381348 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381550 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381871 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.381994 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.382189 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.382325 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.382511 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.382650 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.382825 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.382955 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.383136 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.383264 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.383448 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.383586 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.383753 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.383881 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.384058 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.384188 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.384369 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.384508 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.384683 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.384814 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.385017 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.385150 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.385331 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.385687 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.385942 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.386075 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.386187 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.386313 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.386603 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.386734 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.386909 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.387093 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.387223 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.387536 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.387673 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.387849 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.387980 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.388166 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.388303 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.388488 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.388625 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.388793 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.388923 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.389099 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.389302 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.389446 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.389574 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.389733 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.389877 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390016 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390144 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390339 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390471 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390645 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390774 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.390955 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.391083 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.391263 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.391392 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.391569 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.391705 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.391887 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392016 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392209 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392337 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392514 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392654 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392828 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.392965 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.393141 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.393262 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.393449 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.393577 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.393791 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.393938 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.394103 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.394232 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.394414 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.394541 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.394729 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.394868 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395041 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395168 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395351 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395492 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395654 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395790 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.395963 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.396093 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.396272 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.396400 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.396581 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.396710 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.396891 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397019 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397197 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397326 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397507 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397700 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397830 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.397955 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.398135 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.398405 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.398544 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.398739 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.398876 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.399058 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.399299 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.399437 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.399635 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.399765 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.399953 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.400164 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.400295 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.400420 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.401106 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.401285 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.401543 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.401708 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.401845 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.401979 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.402105 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.402242 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.402412 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.402544 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.402716 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.402852 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403028 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403158 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403336 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403473 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403639 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403767 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.403943 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404080 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404248 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404384 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404553 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404682 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404854 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.404992 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.405159 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.405290 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.405459 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.405589 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.405796 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.405938 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.406099 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.406228 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.406402 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.406541 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.406706 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.406843 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407005 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407134 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407316 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407445 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407617 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407755 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.407920 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408056 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408225 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408355 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408528 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408659 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408831 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.408968 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.409134 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.409319 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.409477 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.409643 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.409805 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.409934 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.410142 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.410282 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.410447 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.410576 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.410775 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.410912 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.411084 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.411222 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.411391 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.411520 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.411697 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.411828 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412001 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412137 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412304 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412441 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412607 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412736 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.412914 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413055 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413223 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413344 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413521 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413678 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413857 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.413995 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.414164 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.414291 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.414473 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.414613 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.414778 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.414908 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415078 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415205 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415376 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415513 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415679 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415808 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.415984 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.416115 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.416973 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.417168 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.417308 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.417436 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.417568 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.417877 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418049 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418180 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418319 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418447 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418572 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418706 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418840 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.418977 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419104 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419230 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419355 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419488 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419614 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.419890 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420017 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420168 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420300 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420490 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420629 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420800 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.420930 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.421103 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.421234 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.421409 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.421549 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.421742 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.421874 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422045 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422175 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422348 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422486 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422655 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422783 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.422957 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.423087 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.423262 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.423402 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.423572 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.423701 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.423883 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424013 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424189 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424332 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424490 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424620 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424791 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.424927 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.425093 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.425222 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.425393 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.425522 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.425705 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.425851 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426014 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426143 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426316 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426453 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426621 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426826 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.426955 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427080 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427205 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427319 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427505 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427645 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427826 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.427955 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.428129 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.428256 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.428431 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.428574 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.428734 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.428871 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.429037 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.429167 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.429379 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.429510 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.429706 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.429837 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430046 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430176 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430358 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430494 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430670 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430805 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.430985 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.431115 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.431291 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.431428 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.431604 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.431744 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.432441 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.432576 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.432766 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.432898 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.433077 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.433207 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.433383 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.433512 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.433719 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.433837 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434027 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434157 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434333 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434472 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434654 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434783 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.434964 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.435101 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.435276 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.435419 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.435584 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.435711 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.435896 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436033 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436211 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436350 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436515 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436650 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436823 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.436952 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.437133 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.437269 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.437442 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.437572 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.437776 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.437904 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.438086 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.438222 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.438398 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.438525 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.438710 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.438838 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.439270 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.439401 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.439580 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.439715 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.439891 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440018 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440198 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440327 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440511 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440640 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440821 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.440948 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.441125 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.441254 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.441431 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.441566 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.441760 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.441902 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442071 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442211 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442375 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442502 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442676 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442811 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.442987 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.443116 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.443294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.443423 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.443701 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.443837 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444014 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444150 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444452 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444629 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444767 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.444937 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.445065 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.445241 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.445376 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.445552 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.445695 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.445890 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.446018 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.446196 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.446341 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.446576 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.446705 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.446882 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.447020 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.447186 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.447316 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.447538 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.448170 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.448348 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.448479 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.448653 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.448792 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.448956 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449085 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449262 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449391 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449568 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449730 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449898 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.449992 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.450202 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.450291 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.450523 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.450623 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.450826 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.450916 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.451145 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.451241 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.451555 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.451668 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.451867 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.451968 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.452175 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.452265 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.452507 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.452608 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.452837 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.452945 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.453166 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.453256 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.453474 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.453563 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.453816 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.453972 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.454130 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.454260 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.454446 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.454575 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.454758 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.454888 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455067 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455198 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455380 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455508 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455688 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455820 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.455997 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.456124 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.456313 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.456449 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.456617 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.456747 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.456937 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.457074 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.457258 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.457394 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.457570 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.457735 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.457916 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.458047 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.458329 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.458477 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.458606 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.458731 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.458913 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459052 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459221 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459365 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459537 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459667 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459843 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.459971 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.460146 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.460284 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.460454 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.460582 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.460759 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.460897 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.461062 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.461211 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.461372 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.461501 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.461706 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.461837 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462016 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462149 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462321 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462452 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462629 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462758 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.462934 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.463100 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.463246 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.463375 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.463567 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.463705 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.463871 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464001 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464192 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464322 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464502 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464631 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464823 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.464992 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.465144 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.465275 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.465448 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.465591 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.465782 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.465911 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.466090 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.466230 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.466392 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.466535 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.466699 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.466836 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467004 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467134 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467349 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467527 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467644 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467769 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.467958 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.468087 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.468286 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.468440 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.468636 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.468764 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.468889 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.469020 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.469219 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.469355 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.469538 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.469700 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.469882 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470012 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470189 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470318 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470498 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470630 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470811 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.470949 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.471111 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.471239 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.471413 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.471545 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.471716 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.471857 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472023 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472152 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472326 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472469 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472629 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472768 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.472939 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.473069 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.473242 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.473380 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.473547 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.473709 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.473877 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474007 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474192 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474320 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474493 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474696 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474827 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.474951 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.475075 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.475200 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.475397 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.475539 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.475703 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.475834 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476006 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476136 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476327 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476456 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476638 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476766 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.476959 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.477088 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.477267 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.477395 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.477583 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.477749 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.477922 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.478053 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.478236 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.478365 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.478551 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.478703 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.478889 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479027 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479201 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479330 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479514 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479642 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479826 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.479967 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.480137 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.480275 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.480453 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.480654 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.480784 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.480983 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.481116 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.481302 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.481570 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.481724 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.481925 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482139 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482270 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482395 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482541 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482679 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482853 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.482984 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.483165 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.483293 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.483475 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.483604 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.483786 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.483917 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.484097 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.484221 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.484408 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.484538 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.484719 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.484858 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.485061 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.485190 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.485380 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.485523 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.485707 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.485836 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.486024 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.486154 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.486338 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.486485 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.486694 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.486830 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487010 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487140 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487319 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487450 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487637 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.487954 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.488084 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.488262 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.488392 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.488573 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.488701 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.488886 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489013 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489199 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489337 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489508 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489658 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489842 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.489983 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.490154 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.490283 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.490462 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.490598 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.490772 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.490911 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.491082 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.491212 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.491393 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.491523 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.491703 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.491841 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492025 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492152 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492341 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492471 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492658 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492787 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.492971 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.493174 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.493304 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.493491 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.493661 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.493852 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.494119 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.494255 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495023 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495163 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495344 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495490 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495821 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.495961 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.496097 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.496271 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.496401 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.496579 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.496711 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.496895 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497032 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497199 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497326 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497503 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497683 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497826 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.497960 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.498136 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.498265 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.498441 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.498570 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.498764 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.498899 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.499073 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.499209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.499376 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.499602 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.499739 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.499949 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.500085 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.500267 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.500505 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.500668 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.500850 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.500989 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.501164 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.501326 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.501489 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.501656 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.501841 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.501974 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.502150 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.502278 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.502460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.502589 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.502776 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.502907 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503080 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503386 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503524 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503689 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503818 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.503999 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.504135 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.504302 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.504433 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.504605 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.504736 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.504915 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505035 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505222 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505362 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505524 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505693 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505858 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.505988 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.506162 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.506306 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.506468 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.506597 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.506779 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.506915 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507082 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507214 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507385 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507516 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507691 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507820 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.507991 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.508128 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.508297 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.508427 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.508600 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.508720 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.508901 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.509023 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.509208 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.509352 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.509537 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.509694 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.509839 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.510047 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.510702 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.510835 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511020 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511165 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511346 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511486 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511656 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511794 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.511957 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.512160 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.512290 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.512414 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.512574 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.512704 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.512875 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.513013 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.513190 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.513319 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.513498 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.513652 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.513880 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.514023 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.514201 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.514331 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.514593 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.514722 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.514942 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.515072 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.515258 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.515398 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.515688 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.515828 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516021 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516151 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516333 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516467 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516642 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516773 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.516949 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.517080 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.517279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.517409 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.517594 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.517779 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.517918 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518047 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518236 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518366 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518691 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518866 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.518986 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.519177 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.519313 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.519487 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.519630 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.519798 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.519929 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.520107 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.520236 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.520415 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.520552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.520725 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.520856 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521035 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521166 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521346 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521476 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521676 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521808 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.521988 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.522129 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.522298 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.522428 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.522612 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.522742 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.522925 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.523056 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.523247 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.523384 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.523567 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.523697 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.523880 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524023 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524191 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524321 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524502 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524625 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524809 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.524947 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.525118 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.525248 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.525425 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.525557 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.525795 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.525938 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.526106 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.526238 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.526436 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.526750 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.526892 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.527057 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.527188 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.527388 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.527715 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.527843 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528026 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528155 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528347 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528477 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528669 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528800 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.528980 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.529117 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.529300 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.529429 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.529627 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.529757 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.529943 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.530072 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.530264 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.530394 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.530575 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.530713 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.530902 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531039 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531213 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531342 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531520 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531668 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531825 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.531962 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.532138 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.532276 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.532448 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.532590 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.532753 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.532890 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.533056 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.533184 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.533365 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.533497 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.533698 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.533831 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534001 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534131 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534299 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534440 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534597 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534719 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.534897 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535033 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535200 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535330 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535500 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535643 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535803 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.535932 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.536106 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.536235 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.536405 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.536533 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.536705 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.536845 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537004 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537140 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537305 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537435 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537642 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537787 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.537916 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538047 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538226 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538355 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538573 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538719 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538847 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.538974 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.539121 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.539251 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.539424 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.539567 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.539724 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.539861 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.540052 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.540181 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.540382 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.540519 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.540692 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.540823 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541004 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541133 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541363 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541493 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541683 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541816 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.541995 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.542125 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.542308 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.542438 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.542630 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.542758 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.542942 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.543071 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.543239 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.543366 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.543560 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.543696 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.543869 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544011 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544178 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544305 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544484 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544613 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544793 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.544961 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.545091 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.545217 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.545399 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.545530 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.545746 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.545894 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.546064 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.546194 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.546366 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.546494 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.546688 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.546818 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547000 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547129 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547315 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547442 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547631 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547759 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.547940 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548069 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548249 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548377 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548563 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548702 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548868 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.548996 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.549177 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.549322 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.549487 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.549658 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.549821 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.549956 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.550137 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.550276 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.550447 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.550575 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.550758 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.550895 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.551074 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.551213 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.551388 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.551516 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.551711 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.551839 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552037 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552166 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552346 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552474 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552672 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552802 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.552998 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.553128 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.553335 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.553473 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.553671 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.553815 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.553986 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.554125 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.554293 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.554433 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.554559 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:40:27.554694 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.554929 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.555234 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:40:27.555476 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:40:27.707309 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO dbcounter [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Registered counter for database nova_api Sep 13 19:40:27.708265 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO dbcounter [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Registered counter for database nova_api Sep 13 19:40:27.727568 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_db.sqlalchemy.engines [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.729920 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_db.sqlalchemy.engines [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.734805 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writer thread running {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.736295 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writer thread running {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.790947 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.context [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70fac71d-69d4-4346-933d-544b74694cfa(cell1) {{(pid=112487) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:40:27.793354 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.context [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70fac71d-69d4-4346-933d-544b74694cfa(cell1) {{(pid=112486) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:40:27.794797 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_concurrency.lockutils [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:40:27.795276 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_concurrency.lockutils [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:40:27.796830 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_concurrency.lockutils [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:40:27.797164 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:40:27.797553 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_concurrency.lockutils [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:40:27.797661 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:40:27.798024 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_concurrency.lockutils [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:40:27.799195 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:40:27.799912 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:40:27.800012 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_concurrency.lockutils [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:40:27.800353 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:40:27.801972 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO dbcounter [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Registered counter for database nova_cell0 Sep 13 19:40:27.802393 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:40:27.804340 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO dbcounter [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Registered counter for database nova_cell0 Sep 13 19:40:27.805961 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO dbcounter [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Registered counter for database nova_cell1 Sep 13 19:40:27.808268 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO dbcounter [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Registered counter for database nova_cell1 Sep 13 19:40:27.813042 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_db.sqlalchemy.engines [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.815891 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_db.sqlalchemy.engines [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.817241 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_db.sqlalchemy.engines [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.819479 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_db.sqlalchemy.engines [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.820376 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writer thread running {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.825684 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writer thread running {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.827959 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writer thread running {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.958363 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writer thread running {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.968716 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO dbcounter [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Registered counter for database nova_cell0 Sep 13 19:40:27.977401 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG oslo_db.sqlalchemy.engines [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.982148 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO dbcounter [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Registered counter for database nova_cell0 Sep 13 19:40:27.982268 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writer thread running {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:27.989046 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_db.sqlalchemy.engines [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:40:27.993441 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writer thread running {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:40:28.320614 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: WARNING keystonemiddleware.auth_token [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:40:28.323688 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: WARNING keystonemiddleware.auth_token [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:40:28.327930 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: WARNING keystonemiddleware.auth_token [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:40:28.330898 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: WARNING keystonemiddleware.auth_token [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:40:28.665556 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: WARNING keystonemiddleware.auth_token [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:40:28.670206 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: WARNING keystonemiddleware.auth_token [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:40:28.672017 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: WARNING keystonemiddleware.auth_token [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:40:28.676093 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: WARNING keystonemiddleware.auth_token [None req-45662fe2-dc59-4687-ab3d-e260a891c3c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:40:28.677228 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ecc00959c0 pid: 112486 (default app) Sep 13 19:40:28.679451 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:40:28.680625 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001858 Sep 13 19:40:28.681030 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Sep 13 19:40:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:40:28.681339 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ecc00959c0 pid: 112487 (default app) Sep 13 19:41:49.792290 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:41:49.793308 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 13 19:41:49.793725 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:41:49.805769 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_api:SELECT=3 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:49.806906 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_cell1:SELECT=3 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:49.807665 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_cell0:SELECT=3 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:49.808873 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:50.678557 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-2272695e-b8ab-4adb-b1d9-676121256cfa admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:41:50.712197 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-2272695e-b8ab-4adb-b1d9-676121256cfa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911657 Sep 13 19:41:50.713063 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 13 19:41:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:53.331006 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:41:53.332092 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-81d62fd8-af1b-4e32-8db2-73d099004567 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 13 19:41:53.332550 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:41:53.798156 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-ee9a9dfc-9d92-4a91-b0f5-f7487b03daa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:41:53.846140 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-ee9a9dfc-9d92-4a91-b0f5-f7487b03daa1 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507369 Sep 13 19:41:53.846694 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:41:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:41:53.861096 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_api:SELECT=3 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.861989 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_cell0:SELECT=3 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.865061 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_cell1:SELECT=3 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:53.866850 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:41:54.079070 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-fe2dfdd7-0808-4c7b-93db-a8fb9037e605 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:41:54.147134 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-fe2dfdd7-0808-4c7b-93db-a8fb9037e605 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292053 Sep 13 19:41:54.147716 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 13 19:41:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:41:56.770047 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-ee9a9dfc-9d92-4a91-b0f5-f7487b03daa1 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:41:56.771611 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-ee9a9dfc-9d92-4a91-b0f5-f7487b03daa1 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Sep 13 19:41:56.772022 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:41:57.421237 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-696912be-3a92-4242-9d18-18b3bd78a6f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:41:57.460383 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-696912be-3a92-4242-9d18-18b3bd78a6f4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.682144 Sep 13 19:41:57.461276 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:41:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:41:57.473357 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-7245b7bb-9a3b-404f-88f4-4e64b1208afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:41:57.516895 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-7245b7bb-9a3b-404f-88f4-4e64b1208afa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047403 Sep 13 19:41:57.525163 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 13 19:41:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:42:00.133468 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-696912be-3a92-4242-9d18-18b3bd78a6f4 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:00.134530 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-696912be-3a92-4242-9d18-18b3bd78a6f4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 13 19:42:00.134930 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:00.555476 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c12470d4-0ffa-4011-9f06-285e1ec58721 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:00.574206 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c12470d4-0ffa-4011-9f06-285e1ec58721 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432442 Sep 13 19:42:00.575433 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:00.587338 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-1db2ef60-d104-4e1a-85d1-030ca501744e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:00.616669 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-1db2ef60-d104-4e1a-85d1-030ca501744e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033195 Sep 13 19:42:00.616819 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 13 19:42:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:03.261670 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c12470d4-0ffa-4011-9f06-285e1ec58721 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:03.262689 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c12470d4-0ffa-4011-9f06-285e1ec58721 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 13 19:42:03.263089 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:03.670713 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-ebd64ddf-7cc6-4799-88e8-b553653b32af admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "ram": 2048}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:03.691407 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-ebd64ddf-7cc6-4799-88e8-b553653b32af admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422175 Sep 13 19:42:03.692706 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:03.705394 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-62dacb92-0e46-4131-adb9-2c213a23bd40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:03.735123 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-62dacb92-0e46-4131-adb9-2c213a23bd40 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034056 Sep 13 19:42:03.735700 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 13 19:42:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:06.351070 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-ebd64ddf-7cc6-4799-88e8-b553653b32af admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:06.352126 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-ebd64ddf-7cc6-4799-88e8-b553653b32af admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Sep 13 19:42:06.352589 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:06.775269 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-fbd68665-39b3-4f13-bb25-db301388a0a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:06.796023 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-fbd68665-39b3-4f13-bb25-db301388a0a2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436875 Sep 13 19:42:06.796841 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:06.808867 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-e8d7724b-a836-4e4a-993a-07248fb81ecd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:06.834426 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-e8d7724b-a836-4e4a-993a-07248fb81ecd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029199 Sep 13 19:42:06.835003 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Tue Sep 13 19:42:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:09.981979 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-fbd68665-39b3-4f13-bb25-db301388a0a2 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:09.983311 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-fbd68665-39b3-4f13-bb25-db301388a0a2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Sep 13 19:42:09.983779 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:10.459759 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-0c77be35-8ed3-46ed-9aa4-d75b06511f19 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:10.484372 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-0c77be35-8ed3-46ed-9aa4-d75b06511f19 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.493685 Sep 13 19:42:10.484929 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 13 19:42:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:13.096008 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-fbd68665-39b3-4f13-bb25-db301388a0a2 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:13.097087 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-fbd68665-39b3-4f13-bb25-db301388a0a2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 13 19:42:13.097493 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:13.494377 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-75a3ea27-f27d-4e4d-bd33-0535d57d9fb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:13.515240 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-75a3ea27-f27d-4e4d-bd33-0535d57d9fb6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411412 Sep 13 19:42:13.515776 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:13.527634 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-a9be1476-6c35-4c90-b59a-6d9e14cab7db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:13.555189 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-a9be1476-6c35-4c90-b59a-6d9e14cab7db admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031085 Sep 13 19:42:13.555758 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 13 19:42:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:16.168974 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-75a3ea27-f27d-4e4d-bd33-0535d57d9fb6 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:16.170074 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-75a3ea27-f27d-4e4d-bd33-0535d57d9fb6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 13 19:42:16.170466 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:16.591864 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-2f8e0103-a3d1-4dcd-b7e9-a80d18986387 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "vcpus": 1, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:16.611042 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-2f8e0103-a3d1-4dcd-b7e9-a80d18986387 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434266 Sep 13 19:42:16.618915 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:16.624188 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-2e5e48f3-a3e8-4df2-a33a-6e0cfb1c62ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:16.649051 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-2e5e48f3-a3e8-4df2-a33a-6e0cfb1c62ef admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028508 Sep 13 19:42:16.666013 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 13 19:42:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:42:19.312595 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-2f8e0103-a3d1-4dcd-b7e9-a80d18986387 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:19.314301 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-2f8e0103-a3d1-4dcd-b7e9-a80d18986387 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002220 Sep 13 19:42:19.326149 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:19 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:19.916166 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-37c8a723-8731-4e52-87e2-fdfa503841e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:19.937627 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-37c8a723-8731-4e52-87e2-fdfa503841e7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.615478 Sep 13 19:42:19.945415 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:19.950687 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-e4bdb84e-b019-4d5c-8dbd-f69be3db6983 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:19.956097 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:19.983468 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-e4bdb84e-b019-4d5c-8dbd-f69be3db6983 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036339 Sep 13 19:42:20.001669 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 13 19:42:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:22.858304 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-37c8a723-8731-4e52-87e2-fdfa503841e7 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:22.859969 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-37c8a723-8731-4e52-87e2-fdfa503841e7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Sep 13 19:42:22.860396 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:23.312800 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-9cc8790e-4691-4d32-b10c-a63f500c295f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:23.334361 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-9cc8790e-4691-4d32-b10c-a63f500c295f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466924 Sep 13 19:42:23.337762 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:42:23.348481 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-68a214e0-2a47-407e-80c7-e30a3be3e5cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:23.374640 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-68a214e0-2a47-407e-80c7-e30a3be3e5cb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029780 Sep 13 19:42:23.375736 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 13 19:42:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:26.074218 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-9cc8790e-4691-4d32-b10c-a63f500c295f admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:26.075845 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-9cc8790e-4691-4d32-b10c-a63f500c295f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Sep 13 19:42:26.076401 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:26.516256 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-8b2d127a-a4ff-4605-b656-686ee6c29c10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:26.523720 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:26.541792 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-8b2d127a-a4ff-4605-b656-686ee6c29c10 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459210 Sep 13 19:42:26.542353 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:42:26.554429 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-da9fadc3-88a2-4727-8902-9a1b3541a186 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:26.580184 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-da9fadc3-88a2-4727-8902-9a1b3541a186 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029432 Sep 13 19:42:26.580686 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Tue Sep 13 19:42:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:42.414649 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-8b2d127a-a4ff-4605-b656-686ee6c29c10 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:42.415694 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-8b2d127a-a4ff-4605-b656-686ee6c29c10 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 13 19:42:42.416087 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:42.427250 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:42.802251 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-5a065280-4ac4-4d16-a7b8-16c4f4a99d75 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:42.821124 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-5a065280-4ac4-4d16-a7b8-16c4f4a99d75 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398861 Sep 13 19:42:42.821678 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 13 19:42:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:42:44.127988 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-8b2d127a-a4ff-4605-b656-686ee6c29c10 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:44.128982 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-8b2d127a-a4ff-4605-b656-686ee6c29c10 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Sep 13 19:42:44.129379 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:44.652217 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-15c785f1-849a-46ad-92e3-480edec8158b admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:44.657507 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.wsgi [None req-15c785f1-849a-46ad-92e3-480edec8158b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-15c785f1-849a-46ad-92e3-480edec8158b admin admin] Request method failure captured: Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Accept: application/json Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Accept-Encoding: gzip, deflate Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Connection: keep-alive Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Content-Length: 0 Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Host: 10.222.0.23 Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Openstack-Api-Version: compute 2.92 Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Openstack-System-Scope: None Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: User-Agent: python-novaclient Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Auth-Token: gAAAAABjIN00s_q7CJOKBCf5PFZvcP4GsK4KUT5h5J-En09v9gXt-e6vgfD_G6FWSZtxw8H9m0kpxby5i9g45HsfMJ0KKaExNtEZT5AchFBHA17zTnqfyxtoOV58c6B3gbQoUCfIGOpYvlcziEAnZnORdNYDHNpf0hHgpK8O1mV4x9TXXLI2xaM Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Domain-Id: None Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Domain-Name: None Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Identity-Status: Confirmed Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Is-Admin-Project: True Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Domain-Id: default Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Domain-Name: Default Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Name: admin Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Role: member,reader,admin Sep 13 19:42:44.660978 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Roles: member,reader,admin Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant: admin Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant-Name: admin Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User: admin Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Domain-Id: default Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Domain-Name: Default Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Id: 6a5ebebe92dd4d8b9d923b7a40d319f7 Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Name: admin Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: method: > Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: exception: Flavor 42 could not be found. Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: action_args: {'id': '42'} Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:42:44.662680 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:44.663741 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.665460 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-15c785f1-849a-46ad-92e3-480edec8158b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:42:44.666783 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-15c785f1-849a-46ad-92e3-480edec8158b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396060 Sep 13 19:42:44.666783 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 13 19:42:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:44.672226 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-546cc477-8e72-46c9-b7db-d18f9fec3a63 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:44.695950 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-546cc477-8e72-46c9-b7db-d18f9fec3a63 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027276 Sep 13 19:42:44.696494 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 13 19:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:44.707203 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-3f98e8c8-d7f4-4c48-ac0c-e466401ac8d0 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:44.729462 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-3f98e8c8-d7f4-4c48-ac0c-e466401ac8d0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026814 Sep 13 19:42:44.730281 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 13 19:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:44.740876 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-59fd7e66-869a-4255-bcb8-cbd6472abc13 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:44.746397 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.wsgi [None req-59fd7e66-869a-4255-bcb8-cbd6472abc13 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-59fd7e66-869a-4255-bcb8-cbd6472abc13 admin admin] Request method failure captured: Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Accept: application/json Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Accept-Encoding: gzip, deflate Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Connection: keep-alive Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Content-Length: 0 Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Host: 10.222.0.23 Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Openstack-Api-Version: compute 2.92 Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Openstack-System-Scope: None Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: User-Agent: python-novaclient Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Auth-Token: gAAAAABjIN00s_q7CJOKBCf5PFZvcP4GsK4KUT5h5J-En09v9gXt-e6vgfD_G6FWSZtxw8H9m0kpxby5i9g45HsfMJ0KKaExNtEZT5AchFBHA17zTnqfyxtoOV58c6B3gbQoUCfIGOpYvlcziEAnZnORdNYDHNpf0hHgpK8O1mV4x9TXXLI2xaM Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Domain-Id: None Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Domain-Name: None Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Identity-Status: Confirmed Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Is-Admin-Project: True Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Domain-Id: default Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Domain-Name: Default Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Name: admin Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Role: member,reader,admin Sep 13 19:42:44.749775 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Roles: member,reader,admin Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant: admin Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant-Name: admin Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User: admin Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Domain-Id: default Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Domain-Name: Default Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Id: 6a5ebebe92dd4d8b9d923b7a40d319f7 Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Name: admin Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: method: > Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: exception: Flavor 42 could not be found. Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: action_args: {'id': '42'} Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:42:44.751324 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:44.752944 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:44.754294 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-59fd7e66-869a-4255-bcb8-cbd6472abc13 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:42:44.755541 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-59fd7e66-869a-4255-bcb8-cbd6472abc13 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014952 Sep 13 19:42:44.756139 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 13 19:42:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:45.974627 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-3f98e8c8-d7f4-4c48-ac0c-e466401ac8d0 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:45.975634 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-3f98e8c8-d7f4-4c48-ac0c-e466401ac8d0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 13 19:42:45.976020 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:46.496309 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-282e618c-7ccd-4a1c-a8ba-e1c498194748 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:46.501254 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.wsgi [None req-282e618c-7ccd-4a1c-a8ba-e1c498194748 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-282e618c-7ccd-4a1c-a8ba-e1c498194748 admin admin] Request method failure captured: Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Accept: application/json Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Accept-Encoding: gzip, deflate Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Connection: keep-alive Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Content-Length: 0 Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Host: 10.222.0.23 Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Openstack-Api-Version: compute 2.92 Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Openstack-System-Scope: None Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: User-Agent: python-novaclient Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Auth-Token: gAAAAABjIN01x-sJTvH4Bx4USeWLKV3Zyzu-q8ycd58KlhVWmfL6BaOBMQpJcS5VoZ5IoLos0drW7iehW1DJmm71zDkgF8_UiszS63_6NTNfl2WHeitHj52QAVNZo46aVH-yNc3_vUHfZMRKFqTc9DrBpHV8sEFOgR9PSE0Aiw5NwZ5ly8YZ4iE Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Domain-Id: None Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Domain-Name: None Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Identity-Status: Confirmed Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Is-Admin-Project: True Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Domain-Id: default Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Domain-Name: Default Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Name: admin Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Role: member,reader,admin Sep 13 19:42:46.503328 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Roles: member,reader,admin Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant: admin Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant-Name: admin Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User: admin Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Domain-Id: default Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Domain-Name: Default Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Id: 6a5ebebe92dd4d8b9d923b7a40d319f7 Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Name: admin Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: method: > Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: exception: Flavor 84 could not be found. Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: action_args: {'id': '84'} Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:42:46.505094 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:46.506245 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.508289 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-282e618c-7ccd-4a1c-a8ba-e1c498194748 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:42:46.509574 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-282e618c-7ccd-4a1c-a8ba-e1c498194748 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393195 Sep 13 19:42:46.509574 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 13 19:42:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 19:42:46.514671 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-dab58941-ac8d-43ed-9f47-94c5e2151176 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:46.531224 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-dab58941-ac8d-43ed-9f47-94c5e2151176 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020041 Sep 13 19:42:46.531750 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 13 19:42:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:46.541793 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-823ada28-aa41-4eff-be43-9ac990a8696e admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:46.557466 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-823ada28-aa41-4eff-be43-9ac990a8696e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019215 Sep 13 19:42:46.558021 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 13 19:42:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:46.567192 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-646b4184-3ffb-48c2-9d7b-f58eb71d290e admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:46.572070 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.wsgi [None req-646b4184-3ffb-48c2-9d7b-f58eb71d290e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-646b4184-3ffb-48c2-9d7b-f58eb71d290e admin admin] Request method failure captured: Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Accept: application/json Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Accept-Encoding: gzip, deflate Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Connection: keep-alive Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Content-Length: 0 Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Host: 10.222.0.23 Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Openstack-Api-Version: compute 2.92 Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Openstack-System-Scope: None Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: User-Agent: python-novaclient Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Auth-Token: gAAAAABjIN01x-sJTvH4Bx4USeWLKV3Zyzu-q8ycd58KlhVWmfL6BaOBMQpJcS5VoZ5IoLos0drW7iehW1DJmm71zDkgF8_UiszS63_6NTNfl2WHeitHj52QAVNZo46aVH-yNc3_vUHfZMRKFqTc9DrBpHV8sEFOgR9PSE0Aiw5NwZ5ly8YZ4iE Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Domain-Id: None Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Domain-Name: None Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Identity-Status: Confirmed Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Is-Admin-Project: True Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Domain-Id: default Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Domain-Name: Default Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Name: admin Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Role: member,reader,admin Sep 13 19:42:46.573552 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Roles: member,reader,admin Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant: admin Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant-Name: admin Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User: admin Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Domain-Id: default Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Domain-Name: Default Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Id: 6a5ebebe92dd4d8b9d923b7a40d319f7 Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Name: admin Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: method: > Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: exception: Flavor 84 could not be found. Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: action_args: {'id': '84'} Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:42:46.575119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:46.576209 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:46.577546 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-646b4184-3ffb-48c2-9d7b-f58eb71d290e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:42:46.578795 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-646b4184-3ffb-48c2-9d7b-f58eb71d290e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011220 Sep 13 19:42:46.578795 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Sep 13 19:42:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 19:42:47.779609 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-823ada28-aa41-4eff-be43-9ac990a8696e admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:47.780625 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-823ada28-aa41-4eff-be43-9ac990a8696e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 13 19:42:47.781016 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:48.301472 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-2ceb4cde-758d-4e96-9dc7-9b1b054a9d93 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:48.307311 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.wsgi [None req-2ceb4cde-758d-4e96-9dc7-9b1b054a9d93 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-2ceb4cde-758d-4e96-9dc7-9b1b054a9d93 admin admin] Request method failure captured: Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Accept: application/json Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Accept-Encoding: gzip, deflate Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Connection: keep-alive Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Content-Length: 0 Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Host: 10.222.0.23 Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Openstack-Api-Version: compute 2.92 Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Openstack-System-Scope: None Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: User-Agent: python-novaclient Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Auth-Token: gAAAAABjIN03o-TizMvt9IeCFIzzQK7cvzXUjkqVPyDINBre3DDBs-2InMT9TqMlnFr_Fz3Ng8mupsg1DfJCZ4_Ju9h3eCzvhp3jJAeQWk43Q5mh-j-P8B4QGseD2D7KF-2CpG35_hw4JrQMPl4KGf2TfTZyjS1dVp0WlcN72F55rwR2BtAJ3yc Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Domain-Id: None Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Domain-Name: None Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Identity-Status: Confirmed Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Is-Admin-Project: True Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Domain-Id: default Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Domain-Name: Default Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Project-Name: admin Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Role: member,reader,admin Sep 13 19:42:48.308804 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Roles: member,reader,admin Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant: admin Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-Tenant-Name: admin Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User: admin Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Domain-Id: default Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Domain-Name: Default Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Id: 6a5ebebe92dd4d8b9d923b7a40d319f7 Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: X-User-Name: admin Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: method: > Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: exception: Flavor 451 could not be found. Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: action_args: {'id': '451'} Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:42:48.310279 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:48.311360 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.312692 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-2ceb4cde-758d-4e96-9dc7-9b1b054a9d93 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:42:48.313959 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-2ceb4cde-758d-4e96-9dc7-9b1b054a9d93 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392424 Sep 13 19:42:48.313959 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 13 19:42:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:48.320141 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-ce78a53e-59ec-43c2-bbad-69df872f80e5 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:48.335339 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-ce78a53e-59ec-43c2-bbad-69df872f80e5 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018740 Sep 13 19:42:48.335857 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 13 19:42:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:48.345030 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:48.360410 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018831 Sep 13 19:42:48.360926 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Sep 13 19:42:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:42:48.369772 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-fefddf2b-aa10-4fc5-a665-588d139ed5c0 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:48.374666 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.wsgi [None req-fefddf2b-aa10-4fc5-a665-588d139ed5c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-fefddf2b-aa10-4fc5-a665-588d139ed5c0 admin admin] Request method failure captured: Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Accept: application/json Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Accept-Encoding: gzip, deflate Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Connection: keep-alive Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Content-Length: 0 Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Host: 10.222.0.23 Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Openstack-Api-Version: compute 2.92 Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Openstack-System-Scope: None Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: User-Agent: python-novaclient Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Auth-Token: gAAAAABjIN03o-TizMvt9IeCFIzzQK7cvzXUjkqVPyDINBre3DDBs-2InMT9TqMlnFr_Fz3Ng8mupsg1DfJCZ4_Ju9h3eCzvhp3jJAeQWk43Q5mh-j-P8B4QGseD2D7KF-2CpG35_hw4JrQMPl4KGf2TfTZyjS1dVp0WlcN72F55rwR2BtAJ3yc Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Domain-Id: None Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Domain-Name: None Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Identity-Status: Confirmed Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Is-Admin-Project: True Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Domain-Id: default Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Domain-Name: Default Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Project-Name: admin Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Role: member,reader,admin Sep 13 19:42:48.376172 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Roles: member,reader,admin Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_61d39e602be54c45a9fb48df499e3bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant: admin Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant-Id: 61d39e602be54c45a9fb48df499e3bc7 Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-Tenant-Name: admin Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User: admin Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Domain-Id: default Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Domain-Name: Default Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Id: 6a5ebebe92dd4d8b9d923b7a40d319f7 Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: X-User-Name: admin Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: method: > Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: exception: Flavor 451 could not be found. Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: action_args: {'id': '451'} Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:42:48.377802 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:48.378670 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: ERROR nova.api.openstack.wsgi Sep 13 19:42:48.379756 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-fefddf2b-aa10-4fc5-a665-588d139ed5c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:42:48.380808 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-fefddf2b-aa10-4fc5-a665-588d139ed5c0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011230 Sep 13 19:42:48.380808 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 13 19:42:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:42:49.720288 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:49.721324 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 13 19:42:49.721907 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:50.245984 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-52edb786-8bf3-4fc9-bd13-e2e417308737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:50.264946 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-52edb786-8bf3-4fc9-bd13-e2e417308737 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.407105 Sep 13 19:42:50.265530 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 13 19:42:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:51.492182 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:51.493212 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 13 19:42:51.493624 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:52.023852 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-13ee5522-7246-496c-9044-b3b166dc4e05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:52.042451 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-13ee5522-7246-496c-9044-b3b166dc4e05 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.409520 Sep 13 19:42:52.042987 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 13 19:42:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:53.270467 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:53.271421 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 13 19:42:53.271811 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:53.788932 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-27d25e18-e50c-420c-9e00-bcd5cfbfc5f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:53.807634 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-27d25e18-e50c-420c-9e00-bcd5cfbfc5f0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398741 Sep 13 19:42:53.808169 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 13 19:42:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:55.020327 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:55.021388 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 13 19:42:55.021829 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:55.548533 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-ab61a2ff-f382-4656-8262-b68accd10584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:55.566989 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-ab61a2ff-f382-4656-8262-b68accd10584 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404709 Sep 13 19:42:55.567514 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Sep 13 19:42:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:42:56.796372 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:56.797361 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 13 19:42:56.797791 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:57.317466 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-068924fc-0b84-4a23-b255-a78210a6af6d admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:57.338257 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-068924fc-0b84-4a23-b255-a78210a6af6d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403675 Sep 13 19:42:57.338797 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Sep 13 19:42:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:53.825106 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:53.826058 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-b7d69b92-3274-4396-9462-90881b878f69 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 13 19:43:53.826982 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Tue Sep 13 19:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:53.837243 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.220481 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-a776cf81-1d4c-42ee-8465-f53d6a10d8e5 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:54.241087 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-a776cf81-1d4c-42ee-8465-f53d6a10d8e5 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408301 Sep 13 19:43:54.241634 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Tue Sep 13 19:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:54.262127 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_api:SELECT=14 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.266068 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-127621b1-ae33-414c-8357-17d03445eb87 admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:54.273389 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-127621b1-ae33-414c-8357-17d03445eb87 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012718 Sep 13 19:43:54.273937 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Tue Sep 13 19:43:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:54.285836 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-4fc92478-40ab-4465-b57b-056bc1cffb3b admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:54.292948 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-4fc92478-40ab-4465-b57b-056bc1cffb3b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010672 Sep 13 19:43:54.293439 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Tue Sep 13 19:43:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:54.305341 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:54.312768 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010945 Sep 13 19:43:54.313270 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Tue Sep 13 19:43:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:54.324074 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-860eb0f5-bc93-44bf-ad5f-b419ba3ad960 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:54.331865 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-860eb0f5-bc93-44bf-ad5f-b419ba3ad960 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011155 Sep 13 19:43:54.332381 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Tue Sep 13 19:43:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:46:57.690082 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:46:57.691119 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 13 19:46:57.691505 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:46:57.832161 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_api:SELECT=6 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:57.993027 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:46:57.997754 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:46:57.998222 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:46:57.998644 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:46:57.999345 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:46:57.999785 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:46:58.000198 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:46:58.032147 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-0495d583-76b8-449a-a866-05707acb39ab admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201167 Sep 13 19:46:58.032734 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 13 19:46:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:59.110797 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:46:59.111799 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 13 19:46:59.112187 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:46:59.302053 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:46:59.305732 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:46:59.306236 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:46:59.306654 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:46:59.307928 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:46:59.308384 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:46:59.308808 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:46:59.328721 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-68c4e5b6-e47d-43f9-ad47-5fc7b4cf8d97 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079756 Sep 13 19:46:59.329157 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 13 19:46:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:10.812686 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:47:10.813772 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 19:47:10.814200 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:47:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:47:10.956182 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_cell0:SELECT=4 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:10.957036 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_cell1:SELECT=4 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:10.957731 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG dbcounter [-] [112486] Writing DB stats nova_api:SELECT=8 {{(pid=112486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:11.008904 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:47:11.012319 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:47:11.012813 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:47:11.013263 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:47:11.014016 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:47:11.014470 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:47:11.014897 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:47:11.040317 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-9c7a582b-d328-411b-af56-b5013abf41ad admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.088468 Sep 13 19:47:11.040805 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 13 19:47:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:47:12.118271 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG nova.api.openstack.wsgi [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] Calling method '>' {{(pid=112487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:47:12.119284 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: INFO nova.api.openstack.requestlog [None req-c9f651ae-6383-48b7-8c5a-1742065b2cbd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 13 19:47:12.119675 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: [pid: 112487|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Sep 13 19:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:47:12.309148 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG nova.api.openstack.wsgi [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Calling method '>' {{(pid=112486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:47:12.312541 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:47:12.313020 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:47:12.313458 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:47:12.314203 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:47:12.314761 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:47:12.315934 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: DEBUG oslo_concurrency.lockutils [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:47:12.337830 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: INFO nova.api.openstack.requestlog [None req-14906c30-31ba-4b2b-881e-14a97905e2fc admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080066 Sep 13 19:47:12.338380 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: [pid: 112486|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Sep 13 19:47:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:48:10.196592 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: Tue Sep 13 19:48:10 2022 - graceful shutdown triggered... Sep 13 19:48:10.196730 dv-cinder-828805-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 19:48:10.197696 dv-cinder-828805-6-iscsi devstack@n-api.service[112486]: Gracefully killing worker 1 (pid: 112486)... Sep 13 19:48:10.198128 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: Gracefully killing worker 2 (pid: 112487)... Sep 13 19:48:10.326255 dv-cinder-828805-6-iscsi devstack@n-api.service[112487]: DEBUG dbcounter [-] [112487] Writing DB stats nova_api:SELECT=4 {{(pid=112487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.199298 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: worker 1 buried after 1 seconds Sep 13 19:48:11.199298 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: worker 2 buried after 1 seconds Sep 13 19:48:11.199298 dv-cinder-828805-6-iscsi devstack@n-api.service[112485]: goodbye to uWSGI. Sep 13 19:48:11.201174 dv-cinder-828805-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 19:48:11.202052 dv-cinder-828805-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 19:48:11.207552 dv-cinder-828805-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 19:48:11.226921 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:48:11 2022] *** Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: nodename: dv-cinder-828805-6-iscsi Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: machine: x86_64 Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: clock source: unix Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: pcre jit disabled Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: detected number of CPU cores: 4 Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: current working directory: / Sep 13 19:48:11.229074 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: your processes number limit is 47680 Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: your memory page size is 4096 bytes Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: detected max file descriptor number: 2048 Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: lock engine: pthread robust mutexes Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: thunder lock: enabled Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 19:48:11.229942 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:48:11.276117 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: Python main interpreter initialized at 0x55cb701e59c0 Sep 13 19:48:11.276117 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: python threads support enabled Sep 13 19:48:11.276117 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: your server socket listen backlog is limited to 100 connections Sep 13 19:48:11.276117 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:48:11.276583 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:48:11.276583 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: *** Operational MODE: preforking *** Sep 13 19:48:11.276771 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:48:11.276771 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: spawned uWSGI master process (pid: 127466) Sep 13 19:48:11.276973 dv-cinder-828805-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 19:48:11.278154 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: spawned uWSGI worker 1 (pid: 127486, cores: 1) Sep 13 19:48:11.278154 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: spawned uWSGI worker 2 (pid: 127487, cores: 1) Sep 13 19:48:11.278154 dv-cinder-828805-6-iscsi devstack@n-api.service[127466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:48:11.927920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:48:11.938230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:48:13.079521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:48:13.079521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: from cryptography.utils import int_from_bytes Sep 13 19:48:13.080167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:48:13.080167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: from cryptography.utils import int_from_bytes Sep 13 19:48:13.109586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:48:13.109586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: from cryptography.utils import int_from_bytes Sep 13 19:48:13.110237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:48:13.110237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: from cryptography.utils import int_from_bytes Sep 13 19:48:15.504558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:48:15.505215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:48:15.505508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:48:15.505755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:48:15.505986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:48:15.506377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.506703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.507020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.507333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.507667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.507994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.508298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.508614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.508938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.509194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.509504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.510025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-6-iscsi {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.510354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.510699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.511010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.511327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.511632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.511953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.512270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.512768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.514301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.514301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.514301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.514580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.514824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.515096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.515419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.515739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.516078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.516361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.516771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-6-iscsi {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.517087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.517406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.517737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.518165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.518476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.518784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.519109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.519435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.519748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.520070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.520388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.520699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.521016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.521317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.521648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.521953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.522268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.522570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.522866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.523117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.523420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.523740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.524059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.524388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.524631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.524876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.525190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.525505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.525842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.526690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.526999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.527302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.527607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.527909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.528214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.528512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.528833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.529141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.529465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.529795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.530116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.530530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.530786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.531077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.531422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.531734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.532046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.532350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.532669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.532974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.533277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.533578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.533919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.534251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.534551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.534824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.535098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.535423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.535714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.536016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.536318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.536662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.536913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.537215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.537525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.537852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.538155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.538459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.538760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.539062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.539364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.539668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.539968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.540290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.540612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.540914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.541219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.541523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.542417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.542739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.543043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.543346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.543666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.543969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.544268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.544581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.544883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.545183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.545497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.545839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.546180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.546454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.546757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.547052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.547350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.547649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.547948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.548248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.548547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.548847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.549141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.549463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.549808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.550116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.550433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.550725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.551043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.551379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.551706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.552311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.552622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.552955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.553287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.553600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.553950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.554357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.554583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.554893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.555203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.555512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.555829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.556144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.556472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.556784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.557093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.557518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.557876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.558193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.558523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.558843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.559157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.559500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.559846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.560158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.560486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.560814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.561126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.561430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.561770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.562108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.562421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.562730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.563047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.563360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.563679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.563986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.564293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.564601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.564911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.565216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.565551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.565905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.566229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.566543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.566854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.567169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.567479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.567789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.568099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.568400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.568704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.569001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.569310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.569711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.570016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.570271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.570582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.570925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.571226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.571536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.571843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.572152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.572453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.572764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.573104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.573408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.573850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.574106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.574411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.574780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.575037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.575341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.575654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.575961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.576270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.576581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.576887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.577208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.577518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.577850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.578221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.578506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.578806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.579124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.579443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.579760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.580065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.580362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.580665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.581043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.581262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.581637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.581887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.582205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.582480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.582779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.583078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.583396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.583698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.583996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.584295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.584550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:48:15.585060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.585232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:48:15.585389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.585389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.585724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:48:15.585887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.586043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:48:15.586204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.586352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:48:15.586508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.586654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.586799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.586951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.587111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.587317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.587477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.587631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.587786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.588012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.588169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.588422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.589108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.589336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.589510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.589796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.589961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.590134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.590394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.590637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.590790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.590952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.591118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.591118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.591490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-6-iscsi {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.591647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.591806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.591979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.592373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.592535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.592691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.592860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.593021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.593175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.593330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.593476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.593654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.593817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.593979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.594245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.594406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.594586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.594759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.594917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.594917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.595262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.595408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.595553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.595706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.595867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.596190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.596381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.596542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.596696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.596854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.597014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.597238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.597404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.597552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.597735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.597885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.598039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.598276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.598447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-6-iscsi {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.598685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.598846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.599002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.599174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.599340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.599568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.599727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.599727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.600128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.600298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.600543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.600785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.600946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.601093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.601249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.601494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.601699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.601865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.602012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.602167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.602433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.602680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.602842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.602997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.603145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.603299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.603456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.603603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.603759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.603905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.604059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.604266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.605022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.605184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.605332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.605478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.605709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.605896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.606062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.606734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.606901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.607069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.607216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.607423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.607584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.607739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.607892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.608046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.608192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.608358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.608513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.608513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.608919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.608919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.609228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.609396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.609563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.609563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.609978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.610202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.610362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.610537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.610778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.611008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.611161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.611316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.611508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.611724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.611882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.612038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.612192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.612357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.612602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.612860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.613014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.613168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.613322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.613479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.613672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.613827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.613985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.613985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.614275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.614437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.614593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.614748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.614912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.615067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.615224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.615384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.615538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.615829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.615994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.616142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.616297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.616444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.616599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.616747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.616892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.617047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.617204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.617351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.617543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.617717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.617877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.618023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.618185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.618333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.618488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.618643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.618791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.618964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.619273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.619273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.619577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.619731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.620010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.620195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.620424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.620582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.620747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.621001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.621231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.621396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.621557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.621758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.621992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.622154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.622154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.622462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.622639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.623001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.623164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.623326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.623473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.623619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.623764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.623917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.624096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.624359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.624537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.624705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.625047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.625215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.625373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.625521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.625521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.625923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.626188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.626352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.626510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.626657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.626802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.626954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.627160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.627333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.627490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.627679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.627834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.627996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.628143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.628297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.628478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.628628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.628787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.629079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.629342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.629507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.629671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.629837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.630002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.630273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.630452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.630687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.630840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.631024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.631265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.631499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.631657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.631820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.631994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.632234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.632393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.632549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.632703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.632875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.633208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.633363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.633518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.633747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.633910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.634067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.634238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.634384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.634538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.634684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.634840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.635039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.635201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.635356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.635533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.635687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.635833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.635978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.636137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.636405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.636556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.636711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.636865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.637021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.637167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.637312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.637465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:48:15.637668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.637823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.637983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.638921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.639207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.639447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.639601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.639755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.639916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.640063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.640235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.640470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.640621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.640871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.641024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.641170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.641396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.641655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.641811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.641976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.642123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.642350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.642502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.642648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.642811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.642973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.643138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.643441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.643590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.643734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.644153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.644316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.644464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.644618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.644618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.644926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.645084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.645242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.645389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.645533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.645711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.645870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.646032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.646180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.646332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.646592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.646745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.646898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.647061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.647233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.647392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.647546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.647736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.647924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.648089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.648246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.648418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.649087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.649245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.649426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.649707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.649707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.650016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.650163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.650309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.650547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.650779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.651787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.651944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.652100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.652254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.652504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.652665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.652813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.652958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.653123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.653298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.653538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.653712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.653859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.654006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.654265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.654433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.654590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.654743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.654894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.655825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.656242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.656389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.656389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.656675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.656848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.657080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.657243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.657405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.657552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.657745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.657959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.658246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.658418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.658418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.658712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.658864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.659966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.660425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.660636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.660636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.661062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.661289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.661456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.661641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.661912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.662101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.662256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.662486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.662708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.662876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.663038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.663199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.663360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.663548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.663771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.663939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.664092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.664264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.664520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.664689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.664861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.665992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.666152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.666306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.666485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.666683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.666846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.667617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.667778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.667987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.668163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.668402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.668570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.668733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.668887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.669039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.669207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.669374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.669526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.669783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.670011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.670171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.670338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.670492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.670645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.670797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.671031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.671201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.671449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.671616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.671782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.671959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.672193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.672368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.672532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.672704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.672926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.673083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.673235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.673403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.673570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.673776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.673999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.674171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.674333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.674516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.674758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.674926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.675081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.675234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.675402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.675556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.675718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.675871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.676032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.676201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.676370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.676532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.676694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.677102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.677265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.677417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.677581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.677581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.678079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.678241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.678413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.678645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.678830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.678993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.679154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.679315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.679468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.679468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.679820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.680026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.680252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.680409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.680570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.680738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.680893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.681075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.681304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.681480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.681737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.681916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.682079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.682338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.682507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.682661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.682815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.683059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.683220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.683373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.683536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.683697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.683860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.684032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.684252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.684252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.684564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.684747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.685000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.685167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.685322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.685474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.685672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.685843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.686945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.687107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.687260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.687412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.687575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.687814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.688106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.688283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.688445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.688616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.688838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.689980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.690153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.690400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.690568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.690723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.690875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.691038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.691200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.691452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.691610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.691855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.692026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.692182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.692360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.692643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.692813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.692968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.693219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.693389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.693542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.693732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.693895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.694057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.694237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.694490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.694657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.694829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.695020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.695831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.696009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.696775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.697018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.697184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.697346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.697510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.697732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.698264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.698443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.698612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.698767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.699013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.699173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.699326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.699494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.699696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.699860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.700022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.700176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.700338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.700594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.700776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.700939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.701093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.701255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.701449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.701702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.701879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.702116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.702285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.702439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.702626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.702866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.703035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.703231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.703472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.703639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.703808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.703970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.704134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.704296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.704469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.704717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.704888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.705050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.705211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.705372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.705537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.705747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.706095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.706262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.706496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.706658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.706812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.706976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.707137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.707293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.707446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.707598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.707752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.707931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.708086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.708396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.708559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.708721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.708885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.709371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.709539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.709719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.709887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.710042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.710205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.710205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.710205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.710937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.711930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.712967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.713060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.713153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.713239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.713239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.713400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.714968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.715969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.716946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.717976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.718920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.719986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.720967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.721963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.722943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.723996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.724822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.725959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.726989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.727908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.728961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.729054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.733406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.733543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.733669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.733752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.733849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.733971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.734897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.735931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.736984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.737967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.738117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.738276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.738434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.738579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.738733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.738886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.739962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.740934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.741994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.742941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.743927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.744700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.745472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.745724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.745932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.746961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.747681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.748967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.749933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.750942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.751979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.752927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.753949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.754126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.754260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.754443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.754569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.754761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.754883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.755071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.755179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.755403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.755501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.755729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.755830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.756047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.756150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.756373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.756468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.756697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.756794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.757974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.758099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.758284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.758411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.758613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.758720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.758921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.759934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.760144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.760241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.760478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.760590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.760787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.760888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.761095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.761188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.761413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.761519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.761747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.761853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.762072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.762176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.762484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.762681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.762781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.763953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.764990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.765201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.765294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.765500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.765596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.765762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:48:15.765857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.766160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.766481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.766813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.767142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.767452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.767784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.768110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.768430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.768760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.769707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.770042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.770352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.770657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.770970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.771277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.771584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.771892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.772202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.772504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.772806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.773109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.773431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.773770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.774097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.774408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.774712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.775025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.775332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.775676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.775982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.776849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.777162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.777487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.777835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.778155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.778470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.778785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.779130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.779445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.779759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.780353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.780676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.780992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.781308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.781888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.782242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.782557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.782870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.783183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.783497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.783810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.784118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.784429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.784739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.785054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.785382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.785759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.786459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.786802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.787125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.787442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.787760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.788076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.788431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.788745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.789054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.789365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.789701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.790015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.790325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.790638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.790948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.791261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.791568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.792451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.792767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.793079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.793402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.793762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.794086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.794402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.794716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.795037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.795557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.795871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.796203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.796527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.796849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.797164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.797479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.797829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.798138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.798443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.798752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.799077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.799365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.799684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.799992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.800295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.800613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.800921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.801452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.801823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.802393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.802721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.803043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.803361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.803668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.803993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.804298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.804604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.804925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.805236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.805543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.805873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.806187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.806496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.806801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.807112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.807476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.807805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.808110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.808416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.808720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.809031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.809335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.809661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.809967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.810270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.810580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.810882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.811288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.811594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.811905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.812254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.812563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.812868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.813191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.813495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.813830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.814150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.814462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.814790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.815102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.815412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.815754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.816072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.816603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.816987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.817285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.817659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.817991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.818300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.818606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.818910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.819232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.819542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.819849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.820159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.820469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.820781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.821088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.821394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.821720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.822028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.822333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.822640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.823499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.823805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.824114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.824426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.824765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.825138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.825405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.825738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.826056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.826370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.826677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.826983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.827290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.827435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO dbcounter [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Registered counter for database nova_api Sep 13 19:48:15.827590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.827922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.828230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.828532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.828951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.829259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.829577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.829915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.830223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.830543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.830862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.831172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.831487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.831794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.832120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.832455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.832781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.833102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.833404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.833798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.834104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.834411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.834726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.835034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.835333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.835631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.835936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.836235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.836538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.836890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.837134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.837438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.837757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.838056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.838355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.839234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.839535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.839837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.840139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.840438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.840742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.841044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.841345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.841661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.841994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.842324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.843943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.843943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.843943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.843943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.843943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.844597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.844741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.845058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.845370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.845729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.846043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.846374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.846675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.846975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.847361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.847587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.847915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.848046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_db.sqlalchemy.engines [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:15.848261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.848546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.848874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.849181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.849502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.849899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.850147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.850475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.850786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.851093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.851434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.851704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.852011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.852323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.852634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.852941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.853253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.853565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.853913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.854268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.854575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.854679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writer thread running {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:15.854899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.855243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.855573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.855883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.856225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.856550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.856863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.857170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.857472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:48:15.857736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:48:15.910769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.context [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70fac71d-69d4-4346-933d-544b74694cfa(cell1) {{(pid=127486) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:48:15.914723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:15.915188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:15.916742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:15.917475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:15.917940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:15.919149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO dbcounter [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Registered counter for database nova_api Sep 13 19:48:15.919929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:15.921937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO dbcounter [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Registered counter for database nova_cell0 Sep 13 19:48:15.925969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO dbcounter [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Registered counter for database nova_cell1 Sep 13 19:48:15.933937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_db.sqlalchemy.engines [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:15.936175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_db.sqlalchemy.engines [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:15.939356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:15.942066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writer thread running {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:15.944168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writer thread running {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:15.946393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writer thread running {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:16.002672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.context [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70fac71d-69d4-4346-933d-544b74694cfa(cell1) {{(pid=127487) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:48:16.006659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:16.007126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:16.008663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:16.009399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:16.009875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:16.012415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:16.014440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO dbcounter [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Registered counter for database nova_cell0 Sep 13 19:48:16.018575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO dbcounter [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Registered counter for database nova_cell1 Sep 13 19:48:16.026960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:16.028913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:16.034923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writer thread running {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:16.037031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writer thread running {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:16.097160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO dbcounter [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Registered counter for database nova_cell0 Sep 13 19:48:16.103916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_db.sqlalchemy.engines [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:16.108713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writer thread running {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:16.185281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO dbcounter [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Registered counter for database nova_cell0 Sep 13 19:48:16.191983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_db.sqlalchemy.engines [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:48:16.196953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writer thread running {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:48:16.428225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:48:16.436096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:48:16.520753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:48:16.528050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:48:16.779922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:48:16.786275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-4d22f50c-0978-4e90-a955-ddd8fc94c7a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:48:16.792515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb701e59c0 pid: 127486 (default app) Sep 13 19:48:16.873021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:48:16.879035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-ed168e13-f4af-4316-95b9-fd94e5dbc434 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:48:16.884386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb701e59c0 pid: 127487 (default app) Sep 13 19:48:54.125710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:54.127061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:54.128111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:54.129450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:55.566583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7db62de5-cbdc-450d-b89e-6d76b58c55bb tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Action: 'create', calling method: .version_select at 0x7f6766177430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-357356253", "metadata": {"Type": "work"}}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:48:57.543456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7db62de5-cbdc-450d-b89e-6d76b58c55bb tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.438726 Sep 13 19:48:57.545217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 13 19:48:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3443 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 19:48:57.566308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:57.567137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:57.568351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:57.569413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:58.024456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ec972bc6-bc4e-4806-b16c-d2460c2e1d0a tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Calling method '.version_select at 0x7f67661d0040>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:58.764829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ec972bc6-bc4e-4806-b16c-d2460c2e1d0a tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b" status: 200 len: 353 microversion: 2.1 time: 1.206995 Sep 13 19:48:58.775589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 19:48:57 2022] GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b => generated 353 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:58.783473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-35bb58e6-13fb-4f2a-8514-0339b1a9511d tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Calling method '.version_select at 0x7f676604b310>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:58.950178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-35bb58e6-13fb-4f2a-8514-0339b1a9511d tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b" status: 200 len: 353 microversion: 2.1 time: 0.173779 Sep 13 19:48:58.963703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 19:48:58 2022] GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:58.975547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-03e7bd89-dcc3-4522-a8c4-be42452bb397 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Calling method '.version_select at 0x7f676602b310>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:59.129659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-03e7bd89-dcc3-4522-a8c4-be42452bb397 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b" status: 202 len: 0 microversion: 2.1 time: 0.158279 Sep 13 19:48:59.130331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:48:58 2022] DELETE /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:48:59.141720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-957058d4-1df9-4369-866a-aa698d7097ac tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Calling method '.version_select at 0x7f676604b9d0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:59.250712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-957058d4-1df9-4369-866a-aa698d7097ac tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b" status: 200 len: 352 microversion: 2.1 time: 0.115119 Sep 13 19:48:59.252140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 19:48:59 2022] GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:59.454302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1429634027", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:48:59.660095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] validate_networks() for [('5abbbb93-feb7-43eb-b8b4-aad4144a4459', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:49:00.265527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e02745d0-aea5-4903-898e-b708dfa416b6 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Calling method '.version_select at 0x7f6765fe20d0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:00.348148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-e02745d0-aea5-4903-898e-b708dfa416b6 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] HTTP exception thrown: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e02745d0-aea5-4903-898e-b708dfa416b6 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Request method failure captured: Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b HTTP/1.1 Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6l70Ydag7vs3_JmPVFSJuzljF7e64C29poCTfYrJtkbx8yMyzudpdWKOCTpNH9lUtRn59FgintraFbs2yuEXQv4-EglaGzrzhO4zyNIT6bOC6bB4qdy4qPM1PHZggYRZqtuUCWoLg9YAlm4q4y3ZKWS92-aCFcvYJjKf7VN5u8LuQ Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: c6b976c5c00245fabdb8577b7c182e20 Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesGetTestJSON-404602518 Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:49:00.354470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6b976c5c00245fabdb8577b7c182e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c6b976c5c00245fabdb8577b7c182e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c6b976c5c00245fabdb8577b7c182e20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c6b976c5c00245fabdb8577b7c182e20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesGetTestJSON-404602518 Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: c6b976c5c00245fabdb8577b7c182e20 Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesGetTestJSON-404602518 Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesGetTestJSON-404602518-project Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 805b4161174b4d47b85153ad41dc4eee Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesGetTestJSON-404602518-project Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'd8220e08-064b-4310-a2f0-a6977d1c5d4b'} Sep 13 19:49:00.357351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. (HTTP 404) (Request-ID: req-b947ba70-247f-4678-b9e7-ccd2172563d8) Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:49:00.358318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:49:00.359572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:49:00.360578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. Sep 13 19:49:00.361786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:49:00.369947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e02745d0-aea5-4903-898e-b708dfa416b6 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] Returning 404 to user: Volume d8220e08-064b-4310-a2f0-a6977d1c5d4b could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:49:00.371207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e02745d0-aea5-4903-898e-b708dfa416b6 tempest-VolumesGetTestJSON-404602518 tempest-VolumesGetTestJSON-404602518-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b" status: 404 len: 109 microversion: 2.1 time: 0.109795 Sep 13 19:49:00.375253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 19:49:00 2022] GET /compute/v2.1/os-volumes/d8220e08-064b-4310-a2f0-a6977d1c5d4b => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:49:02.935759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:49:02.936392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:49:02.936646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:49:02.937381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:49:02.937985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:49:02.969956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:02.970929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:02.972026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:02.977520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:02.978265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:02.979018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:03.058986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for project 6991f30f2c094499b73579677b12abae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:03.081115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for user a0e295fda2af4157b196c6130aa2d6d2 and project 6991f30f2c094499b73579677b12abae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:03.102849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:49:03.108359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:49:03.281788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-156ae506-ef1d-4951-a570-0f951ecbb84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.925833 Sep 13 19:49:03.287764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 3/7] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:48:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:49:03.310794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f2755b8b-31b1-42bf-97b3-2df2d9ffe334 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:03.318669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f2755b8b-31b1-42bf-97b3-2df2d9ffe334 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:03.565878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f2755b8b-31b1-42bf-97b3-2df2d9ffe334 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:03.599832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f2755b8b-31b1-42bf-97b3-2df2d9ffe334 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1222 microversion: 2.1 time: 0.301445 Sep 13 19:49:03.600416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:03 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1222 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:03.887139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1292429939", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:04.060856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] validate_networks() for [('5abbbb93-feb7-43eb-b8b4-aad4144a4459', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:49:06.455836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:49:06.456492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:49:06.457029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:49:06.457879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:49:06.457879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:49:06.486070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:06.487007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:06.487731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:06.489118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:06.489989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:06.490801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:06.520217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for project 6991f30f2c094499b73579677b12abae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:06.526147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for user a0e295fda2af4157b196c6130aa2d6d2 and project 6991f30f2c094499b73579677b12abae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:06.546889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:49:06.551554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:49:06.670112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9bfa452c-1da3-49ae-9fb4-ed805fc06b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.785346 Sep 13 19:49:06.671979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 4/9] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:49:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:49:06.685381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-733f7f0f-b3b8-47f6-b435-546346e1403f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:06.686037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-733f7f0f-b3b8-47f6-b435-546346e1403f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:07.305709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-733f7f0f-b3b8-47f6-b435-546346e1403f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:07.315804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-733f7f0f-b3b8-47f6-b435-546346e1403f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1222 microversion: 2.1 time: 0.635149 Sep 13 19:49:07.320926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 6/10] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:06 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1222 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:08.345865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:08.346583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:08.406983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:08.408770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:08.408770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:08.412813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:08.413308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:08.414311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:09.139031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:09.197256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-592bd46e-7316-4768-bf82-94c236bfea46 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1226 microversion: 2.1 time: 0.855253 Sep 13 19:49:09.198236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 5/11] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:08 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1226 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:10.222962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:10.224254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:10.244467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:10.245238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:10.245899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:10.247060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:10.247742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:10.248315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:10.895571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:10.927242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-267bac18-d91c-4222-b016-61f6a7833c1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1280 microversion: 2.1 time: 0.709092 Sep 13 19:49:10.928562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:10 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1280 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:11.961362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:11.963671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:11.982078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:11.983651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:11.994267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:11.995494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:11.999262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:11.999935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:12.708541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:12.743903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a60547cd-0bc7-41d5-bd75-ed04bc947b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1280 microversion: 2.1 time: 0.789363 Sep 13 19:49:12.755881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:11 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1280 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:13.538115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-400402032", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "networks": [{"uuid": "032d3421-cdcb-4cf5-89bf-0630d226b283"}]}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:13.781944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:13.782961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:13.795578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:13.800964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:13.808568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:13.810430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:13.811129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:13.813984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:13.827799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] validate_networks() for [('032d3421-cdcb-4cf5-89bf-0630d226b283', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:49:14.707767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:14.716670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-23d3f2b6-f333-4ff7-9570-b4e0aa472955 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1280 microversion: 2.1 time: 0.939982 Sep 13 19:49:14.745967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:13 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1280 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:15.788162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:15.789175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:15.809919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:15.814272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:15.814855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:15.818588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:15.820279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:15.822492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:16.156638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:16.236536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-23b6b077-4cc2-47ec-9494-580c1e7ad76a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1280 microversion: 2.1 time: 0.476367 Sep 13 19:49:16.249927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:15 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1280 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:17.284588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:17.286283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:17.316381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:17.359254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:17.360132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=12 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:17.362122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:17.375492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:17.385388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:17.387311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:17.388302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:17.389550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:17.850504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:49:17.851108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:49:17.851684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:49:17.852262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:49:17.852847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:49:17.934972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:17.936334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:17.937326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:17.938836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:17.939959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:17.940818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:18.007044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Getting quotas for project f2c073eb9c7a494ab879f3af8cc96717. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:18.016486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Getting quotas for user 0cf74b3dd4c24c1aa3c0ac659b37c0e1 and project f2c073eb9c7a494ab879f3af8cc96717. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:18.037906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:49:18.043142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:49:18.273580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-871dbdca-272e-4d7b-9cf9-a2597b227bc9 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.854445 Sep 13 19:49:18.273580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 5866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:49:18.307965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-228bca34-300f-44f4-a01d-5c172a3e33de tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:18.313409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-228bca34-300f-44f4-a01d-5c172a3e33de tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:18.458148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:18.524514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-658af490-21e2-4d7a-bebc-a8d687144448 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1280 microversion: 2.1 time: 1.247765 Sep 13 19:49:18.525178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:17 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1280 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:18.807363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-228bca34-300f-44f4-a01d-5c172a3e33de tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:18.832757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-228bca34-300f-44f4-a01d-5c172a3e33de tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1214 microversion: 2.1 time: 0.549172 Sep 13 19:49:18.845019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:18 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:19.552742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:19.554517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:19.577475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:19.585313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:19.587440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:19.591700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:19.599089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:19.600424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:19.899004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8e37235d-6748-4b2c-b2dc-e50ba2eb4736 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'create', calling method: .version_select at 0x7f676563f9d0>, body: {"keypair": {"name": "tempest-keypair-215205948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDEsFejx2D1T1789AmoVv/vt/495zg8rzlFDU+XoqZRfYY6grTYfMc4hU4ShAmBO2Oyx9/utcggfRPL6hjysU/thgmZc4TbxGsIVex9Y9UVMkOuUJDYRn/ceNIP7+Uo8Q=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:20.047695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-8e37235d-6748-4b2c-b2dc-e50ba2eb4736 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for project 2981eddb8742492fac516851f761e2f9. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:20.063494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-8e37235d-6748-4b2c-b2dc-e50ba2eb4736 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for user 15069aa932aa473983c4102961b855d5 and project 2981eddb8742492fac516851f761e2f9. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:20.169449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8e37235d-6748-4b2c-b2dc-e50ba2eb4736 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.332022 Sep 13 19:49:20.172753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 10/19] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:49:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:49:20.182506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:20.184509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:20.201011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:20.202128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:20.202727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:20.203622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:20.204215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:20.204855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:20.719712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:20.731338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d9ff1ce-33e1-4a45-8256-58e1c717d48c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1210 microversion: 2.1 time: 0.557296 Sep 13 19:49:20.732354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:20 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1210 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:21.391751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:21.436872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c4e0b2ac-6b4c-4090-82d2-a8e0d0b3612e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 1.860860 Sep 13 19:49:21.437716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 10/21] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:19 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:21.682154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a75d992a-d49e-4af1-8979-26d52f90b0f9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: .version_select at 0x7f676563f430>, body: {"keypair": {"name": "tempest-keypair-464261076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZdEvDocI/7WXirNM57Idb8fVqEfJqjyPaWoGjvjq01Pv9Fc3b19Jh1tZF4L9TRPSIdEj9nvoYek1WvjN+QVrvZKSTAl8W8mDMWy26XBOadGRW1Vxz4uVwzyNmMEAFV+Q=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:21.758178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-a75d992a-d49e-4af1-8979-26d52f90b0f9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:21.761185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:21.762028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:21.771208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-a75d992a-d49e-4af1-8979-26d52f90b0f9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:21.776045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:21.776553 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:21.776995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:21.777732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:21.786779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:21.789524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:21.839438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a75d992a-d49e-4af1-8979-26d52f90b0f9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.080657 Sep 13 19:49:21.840203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 12/22] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:49:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:22.038808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:22.055775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-55c68ebb-f317-4236-adc5-7e9c13c8c57e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1274 microversion: 2.1 time: 0.297277 Sep 13 19:49:22.058533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:21 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1274 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:22.465412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:22.466602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:22.477172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfc45d7f-3cb6-47cb-830f-222b9263297b", "tag": "5b0d8bba-8f0a-47f5-8dcd-eb25e1c65c7f"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:22.503000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:22.512851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:22.513650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:22.515825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:22.518692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:22.519623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:22.533468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:22.538129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:22.540846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:22.630005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Creating event network-changed:5b0d8bba-8f0a-47f5-8dcd-eb25e1c65c7f for instance dfc45d7f-3cb6-47cb-830f-222b9263297b on hv-cinder-82880 Sep 13 19:49:22.630719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 19:49:22.632265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-51b6b50b-13d8-4b19-802e-ce688a956610 req-b5e5e7d1-93ee-4ff5-8376-e726e0dd7959 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 19:49:22.637436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:22.638694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:22.640375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:22.644596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:22.647092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:22.648854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:22.732505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.compute.rpcapi [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 19:49:22.737388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] Releasing lock "compute-rpcapi-router" {{(pid=127487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 19:49:22.782572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e73e2cab-6864-4313-a9a6-1c4f59f9d129 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.627298 Sep 13 19:49:22.801327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 13/24] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:49:23.091986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:23.094651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:23.119321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:23.124323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:23.125106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:23.127373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:23.130878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:23.132818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:24.228501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:24.237303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4ee4c203-34db-4514-83cb-75f5db8c4e2f tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1272 microversion: 2.1 time: 1.155577 Sep 13 19:49:24.257666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 14/25] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:23 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1272 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:24.765514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:24.792004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8993e490-f15c-452b-843c-17e81d12ac7a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 2.331863 Sep 13 19:49:24.792414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 12/26] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:22 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 2333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:25.272684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:25.273353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:25.298112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:25.302162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:25.302845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:25.306926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:25.308778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:25.309420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:25.824558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:25.826393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:25.838415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:25.843677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:25.846290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:25.846753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:25.848833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:25.849319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:25.860165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:26.326929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:26.335492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5a3a0cb1-f9d5-4891-828b-b9b10cd76f08 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 1.068400 Sep 13 19:49:26.339783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 15/27] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:25 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:26.519254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:26.530760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-d9edf8b5-bdc6-40fc-9bb4-f0cdfcbcdd8c req-0262cc2b-829b-4e74-8a3e-6ef7683c7b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fd1f63a-a05b-4aa2-beea-252f989e8e1d", "tag": "922e5e0a-e86f-491e-9ec3-b0c98bb11069"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:26.535664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-075e81e6-710e-4791-9523-5d7dfa59bf7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.716558 Sep 13 19:49:26.536752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 13/28] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:25 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:26.571951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d9edf8b5-bdc6-40fc-9bb4-f0cdfcbcdd8c req-0262cc2b-829b-4e74-8a3e-6ef7683c7b71 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:26.572439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d9edf8b5-bdc6-40fc-9bb4-f0cdfcbcdd8c req-0262cc2b-829b-4e74-8a3e-6ef7683c7b71 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:26.572875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d9edf8b5-bdc6-40fc-9bb4-f0cdfcbcdd8c req-0262cc2b-829b-4e74-8a3e-6ef7683c7b71 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:26.625032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-d9edf8b5-bdc6-40fc-9bb4-f0cdfcbcdd8c req-0262cc2b-829b-4e74-8a3e-6ef7683c7b71 service nova] Creating event network-changed:922e5e0a-e86f-491e-9ec3-b0c98bb11069 for instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d on hv-cinder-82880 Sep 13 19:49:26.644161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-d9edf8b5-bdc6-40fc-9bb4-f0cdfcbcdd8c req-0262cc2b-829b-4e74-8a3e-6ef7683c7b71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303073 Sep 13 19:49:26.651164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 16/29] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:26.677867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d04d9e00-589c-4f08-85e7-393055f5ce54 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'create', calling method: .version_select at 0x7f676557a550>, body: {"keypair": {"name": "tempest-keypair-459135222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5tlFin2C2KhxiHAR8NvqA0jBjic8DrdOIg1Xi36xkQPtq0eBXU62XvIHZv/0K3R2aqbG2rJo97NBi3ZwoDmkyPBUXGN9wz2WCwA4TWCtNRObmC4AzLnxCPHnytPs0FHg=="}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:26.733671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-d04d9e00-589c-4f08-85e7-393055f5ce54 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:26.748093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-d04d9e00-589c-4f08-85e7-393055f5ce54 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for user 3177776f47ef4d3e937c2e8efb360e79 and project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:26.863345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d04d9e00-589c-4f08-85e7-393055f5ce54 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.325356 Sep 13 19:49:26.863995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 14/30] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Sep 13 19:49:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 326 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 19:49:27.362893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:27.363605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:27.373967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:27.377798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:27.378300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:27.379049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:27.382241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:27.385357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:27.564505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:27.565128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:27.578487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:27.579074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:27.584497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:27.585230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:27.585913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:27.586324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:27.979278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:28.062436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:28.086546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-65a119e8-c266-404c-a953-79ae5e03c32d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.728709 Sep 13 19:49:28.103236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 17/31] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:27 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:28.547431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:28.567362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7368cf74-71f5-4ab8-b906-aa75cb7ee323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 1.005800 Sep 13 19:49:28.584403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:27 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:28.995297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1900635252", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fc9e9d4-f535-4573-a302-00c9e4db1969"}], "security_groups": [{"name": "tempest-securitygroup--1590446321"}], "key_name": "tempest-keypair-215205948", "user_data": "}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:29.020955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:29.115549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:29.116940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:29.127548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:29.130340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:29.130918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:29.131801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:29.133734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:29.136987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:29.301286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] validate_networks() for [('7fc9e9d4-f535-4573-a302-00c9e4db1969', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:49:29.949015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:29.957194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ff602cf-4b13-4d42-8eb4-b76a1e160899 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.845510 Sep 13 19:49:29.963035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 16/33] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:29 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:29.978849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:29.982381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:29.995945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:30.005470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:30.006027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:30.006879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:30.007306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:30.007734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:30.917596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:30.950868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c8da8d5c-8b21-4bca-9873-eab40b696a4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.982035 Sep 13 19:49:30.955208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 17/34] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:29 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:30.992269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:30.992956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:31.007349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:31.007840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:31.010721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:31.014490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:31.015355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:31.016170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:31.795977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=8 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:32.142381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:32.175788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3c8a6649-55ea-4dab-9c12-4c24e6362e41 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 1.187280 Sep 13 19:49:32.188325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 18/35] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:30 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:32.224627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc9b4dc-7483-40d5-ac35-1859f5477446", "tag": "dcbc5d56-3611-4abe-ae9d-3f88fabaf774"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:32.289172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:49:32.289729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:49:32.290315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:49:32.290955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:49:32.291665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:49:32.302590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.305246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.307361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.318536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.322083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.324955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.330776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.331732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.332277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.373979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Creating event network-changed:dcbc5d56-3611-4abe-ae9d-3f88fabaf774 for instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 on hv-cinder-82880 Sep 13 19:49:32.374552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 19:49:32.376872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-400e176a-752d-4132-8e1b-50a541511ca9 req-8e45849e-709f-40fb-a229-d9159d15a1e9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 19:49:32.379414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.382922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.385146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.387497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.390965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.394449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.420684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=65 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:32.430319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.rpcapi [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 19:49:32.435523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] Releasing lock "compute-rpcapi-router" {{(pid=127486) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 19:49:32.468543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7c1140e5-1a00-4126-ab25-16470f4d2953 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277880 Sep 13 19:49:32.470462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for project 2981eddb8742492fac516851f761e2f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:32.479778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 19/36] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:32.486596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for user 15069aa932aa473983c4102961b855d5 and project 2981eddb8742492fac516851f761e2f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:32.490542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:32.493870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:32.514359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.514878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.515324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.516157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:32.516633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:32.517038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:32.525339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:49:32.528928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:49:32.672874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5c8ad1ea-a71f-4bc1-93bc-5e1c3d1e9d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.680455 Sep 13 19:49:32.675443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:49:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:49:32.688110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-516514070", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35be4e76-9541-4147-ba24-d2a973f5a0c4"}], "security_groups": [{"name": "tempest-securitygroup--897318040"}], "key_name": "tempest-keypair-464261076", "user_data": "}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:32.828079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:32.844898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d06ae014-1567-4e2f-a1e6-16fba3245d0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.362687 Sep 13 19:49:32.858233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:32 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:32.883575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-256c60d6-3c88-4534-a57e-51a1857fd020 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:32.886030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-256c60d6-3c88-4534-a57e-51a1857fd020 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:32.986583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] validate_networks() for [('35be4e76-9541-4147-ba24-d2a973f5a0c4', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:49:33.024259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-256c60d6-3c88-4534-a57e-51a1857fd020 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:33.034578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-256c60d6-3c88-4534-a57e-51a1857fd020 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1237 microversion: 2.1 time: 0.172748 Sep 13 19:49:33.035468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:32 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1237 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:33.045862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1516396811", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8baa0457-21f1-4851-9755-1397ee066193"}], "security_groups": [{"name": "tempest-securitygroup--1934984005"}], "key_name": "tempest-keypair-459135222", "user_data": "}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:33.474243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] validate_networks() for [('8baa0457-21f1-4851-9755-1397ee066193', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:49:34.206199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:49:34.208522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:49:34.210457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:49:34.211719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:49:34.212388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:49:34.227077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.227886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.229016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.230390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.231085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.232201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.253578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:34.258060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:34.273082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:49:34.276475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:49:34.361082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-614dddcf-a18a-4f00-86b5-a5e35d19c464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.683238 Sep 13 19:49:34.368472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 19/40] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:49:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:49:34.368634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:49:34.368634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:49:34.368634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:49:34.368634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:49:34.368634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:49:34.379468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:34.379609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.379698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:34.379803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.379936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.382068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.382686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.383291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.395044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.398455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.399956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.400823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.401440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.402150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.480627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:49:34.498708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for user 3177776f47ef4d3e937c2e8efb360e79 and project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:49:34.575493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:49:34.588493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:49:34.779682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d67728d7-1ebf-479c-a423-d183baa6904f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.738564 Sep 13 19:49:34.781543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 22/41] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Sep 13 19:49:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 19:49:34.800172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:34.802248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:34.816101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.816600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.817129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.817915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.818989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.819601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.833310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:34.854243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e240e88c-1dba-4016-901f-8722d55fe97e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.483634 Sep 13 19:49:34.857218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 20/42] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:34 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:34.879244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:34.879862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:34.910257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.910974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.911427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:34.912793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:34.913248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:34.913691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:35.325311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:35.351740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d7988db-c83e-451e-b3c3-042c66036d8c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1297 microversion: 2.1 time: 0.492795 Sep 13 19:49:35.354398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:34 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1297 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:35.380165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7fb40060-ec3f-4806-9366-21047078c9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:35.381327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7fb40060-ec3f-4806-9366-21047078c9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:35.447465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:35.457852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-31c0b176-128c-4e04-9cf1-c9179554be89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.667182 Sep 13 19:49:35.458436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:34 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:35.597201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7fb40060-ec3f-4806-9366-21047078c9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:35.630213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7fb40060-ec3f-4806-9366-21047078c9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1240 microversion: 2.1 time: 0.272485 Sep 13 19:49:35.633208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:35 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1240 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:35.646996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-87703c3c-4536-4493-a8af-4cb40d086670 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:35.648294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-87703c3c-4536-4493-a8af-4cb40d086670 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:35.664415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-2f93d27c-0109-4454-885e-68d715151188 req-9db231a5-5908-49b9-a13c-8d782ef8d568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc45d7f-3cb6-47cb-830f-222b9263297b", "name": "network-vif-plugged", "status": "completed", "tag": "5b0d8bba-8f0a-47f5-8dcd-eb25e1c65c7f"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:35.691572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-2f93d27c-0109-4454-885e-68d715151188 req-9db231a5-5908-49b9-a13c-8d782ef8d568 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:35.692046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-2f93d27c-0109-4454-885e-68d715151188 req-9db231a5-5908-49b9-a13c-8d782ef8d568 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:35.692482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-2f93d27c-0109-4454-885e-68d715151188 req-9db231a5-5908-49b9-a13c-8d782ef8d568 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:35.751902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-2f93d27c-0109-4454-885e-68d715151188 req-9db231a5-5908-49b9-a13c-8d782ef8d568 service nova] Creating event network-vif-plugged:5b0d8bba-8f0a-47f5-8dcd-eb25e1c65c7f for instance dfc45d7f-3cb6-47cb-830f-222b9263297b on hv-cinder-82880 Sep 13 19:49:35.762035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-2f93d27c-0109-4454-885e-68d715151188 req-9db231a5-5908-49b9-a13c-8d782ef8d568 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278692 Sep 13 19:49:35.766094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 24/46] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:35.807684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-87703c3c-4536-4493-a8af-4cb40d086670 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:35.821931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-87703c3c-4536-4493-a8af-4cb40d086670 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:35.838249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-87703c3c-4536-4493-a8af-4cb40d086670 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:35.839656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-87703c3c-4536-4493-a8af-4cb40d086670 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1281 microversion: 2.20 time: 0.203128 Sep 13 19:49:35.843477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:35 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:35.882597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:35.883612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:35.897490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:35.906475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:35.907465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:35.910073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:35.914562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:35.915472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:36.376491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:36.377813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:36.388322 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:36.389782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:36.403130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:36.404091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:36.410534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:36.413867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:36.738229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:36.741155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=81 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:36.754755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-92968f08-29cd-402c-9bc7-e756004a8bb1 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.876686 Sep 13 19:49:36.757733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:35 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:36.776610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:36.777729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:36.791867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:36.793415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:36.795076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:36.796341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:36.799012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:36.800167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.109332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:37.117998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-447e06be-8723-4fb6-acfb-962e3d97f741 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.745608 Sep 13 19:49:37.121502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 24/49] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:36 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:37.132979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:37.133890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:37.148078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.150839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.151462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.158201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.158557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.159061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.336931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:37.346756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d6d45d0-879f-42a4-9353-a11936c1d3e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1310 microversion: 2.1 time: 0.221604 Sep 13 19:49:37.351489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 25/50] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:37 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1310 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:37.373678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:37.374712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:37.389977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.390663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.390919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.398581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.399313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.399909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.423950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:37.432890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ba51bc35-be0c-482a-b778-5f14994b3c72 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.672657 Sep 13 19:49:37.446004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 26/51] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:36 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:37.578354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:37.591315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:37.594537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:37.597228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d0e8cf32-bc51-471e-8989-d05b8fd8cba7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1333 microversion: 2.20 time: 0.244647 Sep 13 19:49:37.601844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:37 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1333 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:37.783505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:37.784050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:37.804204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.811615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.812308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.825406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.826118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.826719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.964839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-36cb2dc1-a7fe-4f05-b568-c15719cb8b7a req-d6621213-ff51-487d-8438-d6c6bf137c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd1f63a-a05b-4aa2-beea-252f989e8e1d", "name": "network-vif-plugged", "status": "completed", "tag": "922e5e0a-e86f-491e-9ec3-b0c98bb11069"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:37.979033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-36cb2dc1-a7fe-4f05-b568-c15719cb8b7a req-d6621213-ff51-487d-8438-d6c6bf137c12 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:37.979920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-36cb2dc1-a7fe-4f05-b568-c15719cb8b7a req-d6621213-ff51-487d-8438-d6c6bf137c12 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:37.980699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-36cb2dc1-a7fe-4f05-b568-c15719cb8b7a req-d6621213-ff51-487d-8438-d6c6bf137c12 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:37.996380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-36cb2dc1-a7fe-4f05-b568-c15719cb8b7a req-d6621213-ff51-487d-8438-d6c6bf137c12 service nova] Creating event network-vif-plugged:922e5e0a-e86f-491e-9ec3-b0c98bb11069 for instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d on hv-cinder-82880 Sep 13 19:49:38.002808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-36cb2dc1-a7fe-4f05-b568-c15719cb8b7a req-d6621213-ff51-487d-8438-d6c6bf137c12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044267 Sep 13 19:49:38.003945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 27/53] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:49:38.150668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:38.151319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:38.158019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.158725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.159160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.159935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.160393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.160819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.534637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:38.545231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8bb4fc16-d389-4923-ba98-b8fd223da61d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.765632 Sep 13 19:49:38.552364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 27/54] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:37 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:38.567036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:38.569951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:38.586185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.589800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.590366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.591283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.591743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.592160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.700996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:38.709730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1cb407f7-d462-4402-9017-5c3b0234a3f9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.565629 Sep 13 19:49:38.712932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 28/55] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:38 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:38.722341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:38.725128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:38.741156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.741713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.742152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.743019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.753672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.754165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.786454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:38.799466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f666f56e-694b-45d9-ac4d-476e6154ecbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1298 microversion: 2.1 time: 0.244884 Sep 13 19:49:38.804983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 28/56] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:38 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:38.822643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:38.823701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:38.838195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.840255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.842258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:38.846267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:38.847886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:38.851560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:39.064648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:39.080828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:39.092903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:39.098284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-383d8a35-55a8-423e-ae9a-5204f7776790 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1339 microversion: 2.20 time: 0.291695 Sep 13 19:49:39.101755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:38 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:39.134973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:39.145945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6233af02-3a46-4d71-8e0c-00233081742b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.431044 Sep 13 19:49:39.147773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 29/58] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:38 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:39.411467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-dabeb0f2-6217-46ed-b066-965eb096368f req-a73f99f1-e3cb-42d3-966a-b5ad64f6a160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3965b308-7b06-4c6b-8cf6-a14e471c13b9", "tag": "7ef6f233-e8a9-46ca-913a-804b61bdeb70"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:39.425649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-dabeb0f2-6217-46ed-b066-965eb096368f req-a73f99f1-e3cb-42d3-966a-b5ad64f6a160 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:39.426477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-dabeb0f2-6217-46ed-b066-965eb096368f req-a73f99f1-e3cb-42d3-966a-b5ad64f6a160 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:39.427204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-dabeb0f2-6217-46ed-b066-965eb096368f req-a73f99f1-e3cb-42d3-966a-b5ad64f6a160 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:39.444292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-dabeb0f2-6217-46ed-b066-965eb096368f req-a73f99f1-e3cb-42d3-966a-b5ad64f6a160 service nova] Creating event network-changed:7ef6f233-e8a9-46ca-913a-804b61bdeb70 for instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 on hv-cinder-82880 Sep 13 19:49:39.450614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-dabeb0f2-6217-46ed-b066-965eb096368f req-a73f99f1-e3cb-42d3-966a-b5ad64f6a160 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043352 Sep 13 19:49:39.452069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 30/59] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:39.573080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:39.574173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:39.586556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:39.587286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:39.587790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:39.588845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:39.590580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:39.591216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:39.749096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:39.752950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:39.780800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:39.781335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:39.784208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:39.788079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:39.790510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:39.792815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.304099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:40.318632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0d297842-c95a-4f13-b12f-f86d4dc51176 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.582682 Sep 13 19:49:40.319308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:39 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:40.332609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:40.335874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:40.343308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:40.352092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9a5438a2-2f8d-4be1-86f5-84ef6839c32c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.785624 Sep 13 19:49:40.352626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:40.366775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:40.366775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.366775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:40.366775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:40.367321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.368607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 30/61] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:39 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:40.377194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:40.378805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:40.386013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:40.386803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:40.387437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.388830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:40.389469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:40.390102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.660868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:40.675721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:40.679495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:40.688103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3426f3e-3ce7-4a7a-bdba-58b490117894 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1339 microversion: 2.20 time: 0.310492 Sep 13 19:49:40.689540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:40 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:40.710046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:40.710656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:40.735275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:40.736816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:40.738231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.740685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:40.741457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:40.742284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:40.965973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:40.976242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3fe13fdb-2578-410f-8c50-c2e2e9d7f7a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.654731 Sep 13 19:49:40.980023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:40 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:40.988811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-94c3c44f-1b28-45b4-9ded-c76f2f7ed727 req-a95b60ef-55b1-4492-9311-da4718826dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc9b4dc-7483-40d5-ac35-1859f5477446", "name": "network-vif-plugged", "status": "completed", "tag": "dcbc5d56-3611-4abe-ae9d-3f88fabaf774"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:41.002123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-94c3c44f-1b28-45b4-9ded-c76f2f7ed727 req-a95b60ef-55b1-4492-9311-da4718826dc1 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.003222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-94c3c44f-1b28-45b4-9ded-c76f2f7ed727 req-a95b60ef-55b1-4492-9311-da4718826dc1 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.003901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-94c3c44f-1b28-45b4-9ded-c76f2f7ed727 req-a95b60ef-55b1-4492-9311-da4718826dc1 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.018713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-94c3c44f-1b28-45b4-9ded-c76f2f7ed727 req-a95b60ef-55b1-4492-9311-da4718826dc1 service nova] Creating event network-vif-plugged:dcbc5d56-3611-4abe-ae9d-3f88fabaf774 for instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 on hv-cinder-82880 Sep 13 19:49:41.029840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-94c3c44f-1b28-45b4-9ded-c76f2f7ed727 req-a95b60ef-55b1-4492-9311-da4718826dc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047615 Sep 13 19:49:41.030896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 33/64] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:41.168619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:41.184218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-21977e29-4ac3-4bd8-a3f4-9e321a2fca04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1322 microversion: 2.1 time: 0.493342 Sep 13 19:49:41.186717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 32/65] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:40 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:41.345489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:41.346218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:41.361481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.362187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.363148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.364078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.364879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.366536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.380255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:41.380902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:41.390530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.390775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.392752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.393662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.396316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.396965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.741655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:41.744550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:41.752903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f6020935-bee4-4ed7-92f4-7992281f7496 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.376392 Sep 13 19:49:41.753979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-86f4e443-038d-4614-a766-748548b1a809 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.413257 Sep 13 19:49:41.757220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:41 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:41.768264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:41 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:41.769810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-d34d7514-bffb-4c5c-9800-0eb71e4c43e4 req-07edd4e9-59d1-4d9b-afbb-84129b34b9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0", "tag": "002e649f-2cce-4efe-82ec-68136953168c"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:41.784372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:41.785054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:41.787630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d34d7514-bffb-4c5c-9800-0eb71e4c43e4 req-07edd4e9-59d1-4d9b-afbb-84129b34b9e9 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.788311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d34d7514-bffb-4c5c-9800-0eb71e4c43e4 req-07edd4e9-59d1-4d9b-afbb-84129b34b9e9 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.788954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d34d7514-bffb-4c5c-9800-0eb71e4c43e4 req-07edd4e9-59d1-4d9b-afbb-84129b34b9e9 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.799330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.803541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.804147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.804468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-d34d7514-bffb-4c5c-9800-0eb71e4c43e4 req-07edd4e9-59d1-4d9b-afbb-84129b34b9e9 service nova] Creating event network-changed:002e649f-2cce-4efe-82ec-68136953168c for instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 on hv-cinder-82880 Sep 13 19:49:41.810934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:41.811509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:41.811994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:41.812393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-d34d7514-bffb-4c5c-9800-0eb71e4c43e4 req-07edd4e9-59d1-4d9b-afbb-84129b34b9e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052160 Sep 13 19:49:41.816793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 34/68] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:42.003972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:42.005037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:42.027323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:42.033315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.033845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.034280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.034983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.035431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.035851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.042522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:42.043952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:42.045221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2242c61e-fde1-488b-b945-0d051001e8bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.275909 Sep 13 19:49:42.045791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 35/69] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:41 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:42.222110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:42.222710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:42.234287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.234927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.236075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.239417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.239926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.240556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.600788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:42.620780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1bd39158-0f84-4c7c-8d25-43df920b538b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.622036 Sep 13 19:49:42.621781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:41 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:42.646033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:42.654880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-93b94c6e-65dc-4f3b-a6bf-8bd0e26c12ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1515 microversion: 2.1 time: 0.436845 Sep 13 19:49:42.662004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 36/71] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:42 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:42.685219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:42.687861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:42.694288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.695207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.695920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.696858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.697517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.698259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.784112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:42.784983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:42.792149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'flavor' on Instance uuid 1fd1f63a-a05b-4aa2-beea-252f989e8e1d {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:49:42.794572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.796536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.797220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:42.798170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:42.801270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:42.801983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.038686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29113150-fa29-4e8b-903a-c079c8e716ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d/action" status: 200 len: 32 microversion: 2.1 time: 0.356847 Sep 13 19:49:43.044976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:49:42 2022] POST /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:49:43.048821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:43.051729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:43.055752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:43.060912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-28f52292-b94a-4f23-9a95-d1e5d31c85be tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.280713 Sep 13 19:49:43.078248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 37/73] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:42 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:43.078248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:43.078248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:43.078607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.079126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.079561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.080266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.080754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.081163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.103067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.103572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.104110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.104816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.108484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.108484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.133804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:43.806255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:43.811217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:43.837962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-703e24bd-5fbf-48b0-ab10-897bfd1a1666 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.772226 Sep 13 19:49:43.854533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0ec3273c-9f8d-4167-b3d2-a077258c0e9d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.790497 Sep 13 19:49:43.856009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 38/74] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:43 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:43.869637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 37/75] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:43 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:43.874716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:43.874902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:43.875662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:43.876764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:43.892030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.892525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.893886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.894506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.895697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.896475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.896922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.897671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.898819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:43.899306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:43.899736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:43.900460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.240548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:44.394107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:44.450198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:44.453919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:44.463107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:44.464171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-818451ef-0288-4e87-9dc8-58719f3afdfb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.602476 Sep 13 19:49:44.465172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 38/76] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:43 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:44.478951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:44.485648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0b4fb99b-41cd-4f21-ba18-c23b5a557053 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.623051 Sep 13 19:49:44.485648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 39/77] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:43 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:44.485905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-a5dd4617-3457-4f9d-b7fc-3ec354c9f1cc req-74d601c8-e252-4f3d-8692-86bfe0544e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:44.492459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:44.493400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:44.504518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a5dd4617-3457-4f9d-b7fc-3ec354c9f1cc req-74d601c8-e252-4f3d-8692-86bfe0544e2a service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.505062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a5dd4617-3457-4f9d-b7fc-3ec354c9f1cc req-74d601c8-e252-4f3d-8692-86bfe0544e2a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.505188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.505552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a5dd4617-3457-4f9d-b7fc-3ec354c9f1cc req-74d601c8-e252-4f3d-8692-86bfe0544e2a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.505759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.506199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.506914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.507566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.507993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.529312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-a5dd4617-3457-4f9d-b7fc-3ec354c9f1cc req-74d601c8-e252-4f3d-8692-86bfe0544e2a service nova] Creating event network-changed:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:49:44.540667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=20 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:44.540984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-a5dd4617-3457-4f9d-b7fc-3ec354c9f1cc req-74d601c8-e252-4f3d-8692-86bfe0544e2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065071 Sep 13 19:49:44.542378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 39/78] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:44.707468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:44.715461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e56aa581-4ff6-4d0c-a315-ab0341f4e074 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1314 microversion: 2.1 time: 0.230181 Sep 13 19:49:44.716147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 40/79] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:44 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:44.887013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:44.888034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:44.888665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:44.889974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:44.903757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.904734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.905449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.905826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.906252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.907013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.907460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.907873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.909132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:44.909880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:44.910333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:44.910755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.339356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:45.348660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-671b5b65-c403-4e73-907e-f66ca799705f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.473155 Sep 13 19:49:45.350183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 40/80] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:44 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:45.356358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:45.364637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-262f34c3-f3c8-4118-a64f-84914750e0a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.485234 Sep 13 19:49:45.365281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 41/81] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:44 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:45.493512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:45.494171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:45.501274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:45.501780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:45.502205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.504295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:45.504936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:45.507567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.513225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:45.514070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:45.524722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:45.525134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:45.525543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.527575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:45.530974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:45.531417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.768863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:45.771776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:45.781886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8555150a-c671-4f31-85f7-dd03dec592bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.290684 Sep 13 19:49:45.782155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:45.783225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 41/82] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:45 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:45.783385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:45.784685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-53d555e0-9b5f-4c81-9fa8-b9cab9f4cb84 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.275913 Sep 13 19:49:45.785385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 42/83] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:45 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:45.788323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:45.789006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:45.794984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:45.795730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:45.796234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.797123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:45.797806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:45.798428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:45.829799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=16 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:46.161418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:46.180764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-40912a58-b952-4a5f-a01b-4ab248302fdd tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1501 microversion: 2.1 time: 0.396101 Sep 13 19:49:46.181363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 42/84] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:45 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1501 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:46.232490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-d6075afc-f0f4-4dae-a290-b222e8c08ec2 req-29904cce-53c6-47d1-a74b-23bd26f8d5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3965b308-7b06-4c6b-8cf6-a14e471c13b9", "name": "network-vif-plugged", "status": "completed", "tag": "7ef6f233-e8a9-46ca-913a-804b61bdeb70"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:46.249991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-d6075afc-f0f4-4dae-a290-b222e8c08ec2 req-29904cce-53c6-47d1-a74b-23bd26f8d5b9 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.251144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-d6075afc-f0f4-4dae-a290-b222e8c08ec2 req-29904cce-53c6-47d1-a74b-23bd26f8d5b9 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.251933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-d6075afc-f0f4-4dae-a290-b222e8c08ec2 req-29904cce-53c6-47d1-a74b-23bd26f8d5b9 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.285929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-d6075afc-f0f4-4dae-a290-b222e8c08ec2 req-29904cce-53c6-47d1-a74b-23bd26f8d5b9 service nova] Creating event network-vif-plugged:7ef6f233-e8a9-46ca-913a-804b61bdeb70 for instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 on hv-cinder-82880 Sep 13 19:49:46.298073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-d6075afc-f0f4-4dae-a290-b222e8c08ec2 req-29904cce-53c6-47d1-a74b-23bd26f8d5b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071315 Sep 13 19:49:46.300067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 43/85] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:46.372762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:46.373369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:46.390258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.391115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.391982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.393395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.394045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:46.394868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.394993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:46.396890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.407360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.407908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.408804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.410192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.411154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.420835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.439224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:46.763587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:46.781167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8dcf5b03-d331-493e-a15d-48ebab9a0c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.411922 Sep 13 19:49:46.786134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 43/86] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:46 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:46.793448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:46.810298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7eaad255-6289-425c-a825-9a48a2d6fe2e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.420743 Sep 13 19:49:46.810851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:46.811774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:46.818775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 44/87] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:46 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:46.820320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.821419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.822184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.823333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.823955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.824294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:46.824953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:46.825264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.832004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.832489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.833085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:46.833874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:46.834321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:46.834769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:47.050449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:47.051053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:47.069790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:47.070308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4970eece-59f0-4248-a464-b83c88c6f8ef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.262461 Sep 13 19:49:47.071386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 44/88] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:46 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:47.073433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:47.074920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4fb570f4-99a5-4b4d-ba4c-7f0175fe857b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.254856 Sep 13 19:49:47.075511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 45/89] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:46 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:47.808345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:47.809108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:47.819382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:47.819800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:47.835651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:47.836874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:47.840589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:47.847844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:47.847844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:47.847844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:47.850570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:47.851966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:47.853253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:47.855328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:47.855793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:47.856254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.202362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:48.211409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4a2a0d7-d811-49a7-9ff4-fcb3bb2178e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.406992 Sep 13 19:49:48.212467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 45/90] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:47 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:48.217833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c4e2d05-5771-49bf-a0c3-3889153e43bc"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:48.219155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:48.220759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:48.228698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:48.229686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:48.230301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.230996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:48.231613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:48.232254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.234262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eee94f8e-d496-4565-8465-84a326518265 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.402539 Sep 13 19:49:48.237804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:47 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:48.243500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:48.244564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:48.267365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:48.267860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:48.268372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.269187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:48.269711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:48.270203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.579141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:48.587655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d2dc72e3-07ab-48fd-ac9f-79c0c90b6c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.348090 Sep 13 19:49:48.588556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 47/92] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:48 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:48.593793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:48.594676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:48.602549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:48.603277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:48.603923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.604885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:48.605536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:48.606681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:48.783761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:48.796972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:48.798498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:48.799857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f58bbdee-fc82-4a94-89ca-1dfdba3d13f1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.209544 Sep 13 19:49:48.813638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 48/93] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:48 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:48.981831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-682a1863-33f0-43d7-905a-6ba508912193 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "POST /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767689 Sep 13 19:49:48.982538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 46/94] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:49:48 2022] POST /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:49.237357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:49.238252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:49.240847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:49.252412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.252882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.253323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.254130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.254583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.255040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.266985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:49.267702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:49.274284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.274767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.275495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.276384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.276840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.277299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.477866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:49.483966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:49.499766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-90aa1557-30c8-4811-bf27-e313d81d36ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.265883 Sep 13 19:49:49.500298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 49/95] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:49 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:49.510550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-47f06ab6-b2d7-42bc-b550-f471f523ad70 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1363 microversion: 2.1 time: 0.248354 Sep 13 19:49:49.516002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 47/96] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:49 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:49.610863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:49.611391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:49.619938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.620440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.621002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.622360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.622820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.623781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.827651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:49.828737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:49.843088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:49.845240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.849625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.850083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.850856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:49.851721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:49.852263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:49.856475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-51e2f256-8abb-4f3d-98af-345f47405534 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.249496 Sep 13 19:49:49.869772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 50/97] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:49 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:50.140827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:50.150639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:50.153684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:50.155282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3961f24e-bf65-46c8-87b5-b0e5894e06d0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.331853 Sep 13 19:49:50.156381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 48/98] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:49 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:49:50.285645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-a85daa74-31ab-4163-94b6-30f1b748209f req-bb63bd11-cfa9-4c76-8fa3-367bac758ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0", "name": "network-vif-plugged", "status": "completed", "tag": "002e649f-2cce-4efe-82ec-68136953168c"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:50.295813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-a85daa74-31ab-4163-94b6-30f1b748209f req-bb63bd11-cfa9-4c76-8fa3-367bac758ef0 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.296338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-a85daa74-31ab-4163-94b6-30f1b748209f req-bb63bd11-cfa9-4c76-8fa3-367bac758ef0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.297002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-a85daa74-31ab-4163-94b6-30f1b748209f req-bb63bd11-cfa9-4c76-8fa3-367bac758ef0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.316304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-a85daa74-31ab-4163-94b6-30f1b748209f req-bb63bd11-cfa9-4c76-8fa3-367bac758ef0 service nova] Creating event network-vif-plugged:002e649f-2cce-4efe-82ec-68136953168c for instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 on hv-cinder-82880 Sep 13 19:49:50.322698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-a85daa74-31ab-4163-94b6-30f1b748209f req-bb63bd11-cfa9-4c76-8fa3-367bac758ef0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040874 Sep 13 19:49:50.323783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 51/99] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:50.522639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:50.523245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:50.530092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.530704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.531215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.532026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.532544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.532974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.534587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:50.535741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:50.544907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.545678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.546235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.547099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.547457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.547798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.798958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:50.814796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4b647ff3-474d-400e-9431-3429bcf70efa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.295995 Sep 13 19:49:50.815511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:50 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:50.855406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:50.865171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-73d9247e-9702-489c-a77f-f47f89794abe tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1550 microversion: 2.1 time: 0.334179 Sep 13 19:49:50.865978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:50 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1550 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:50.882614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:50.883619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:50.885907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:50.892141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:50.892521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.893023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:50.893193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.893802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.894946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.896379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.897031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.902147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.902696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.903161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:50.904051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:50.904903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:50.905821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:51.085155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1b12ca4a-7f5a-42b1-a8ed-8fc998d31a60 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197943 Sep 13 19:49:51.085885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 53/102] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:49:50 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:51.126094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:51.139755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-44012316-eb3e-4294-a6e5-da53ef0c8bfa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.260962 Sep 13 19:49:51.154571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 50/103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:50 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:49:51.186944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:51.187723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:51.198479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:51.198960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:51.199738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:51.201716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:51.202436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:51.203041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:51.383838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:51.396295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:51.398666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:51.400097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-60502da8-f8c3-4727-bd11-7ae7c60090f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.219967 Sep 13 19:49:51.413634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 54/104] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:51 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:51.841452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:51.842140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:51.851278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:51.852053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:51.852553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:51.853370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:51.854020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:51.854516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:52.168688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:52.169268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:52.186873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:52.191131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:52.191657 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:52.197949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:52.198725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:52.199790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:52.228283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:52.244181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9eb84041-42c7-49d6-9bea-1b8f740883ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.406165 Sep 13 19:49:52.245392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 51/105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:51 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:52.367068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-24b5afe2-e730-433f-9c51-d4e1eb7c920c req-1021bd59-0569-448c-a798-018410efbac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "name": "network-vif-plugged", "status": "completed", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:52.381623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-24b5afe2-e730-433f-9c51-d4e1eb7c920c req-1021bd59-0569-448c-a798-018410efbac0 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:52.383303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-24b5afe2-e730-433f-9c51-d4e1eb7c920c req-1021bd59-0569-448c-a798-018410efbac0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:52.389042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-24b5afe2-e730-433f-9c51-d4e1eb7c920c req-1021bd59-0569-448c-a798-018410efbac0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:52.396040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:52.407821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-754d3581-e981-4f48-9bc5-d712384e751e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1365 microversion: 2.1 time: 0.245479 Sep 13 19:49:52.413561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 55/106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:52 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:52.413783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-24b5afe2-e730-433f-9c51-d4e1eb7c920c req-1021bd59-0569-448c-a798-018410efbac0 service nova] Creating event network-vif-plugged:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:49:52.426312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-24b5afe2-e730-433f-9c51-d4e1eb7c920c req-1021bd59-0569-448c-a798-018410efbac0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064339 Sep 13 19:49:52.428206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 52/107] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:52.431565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:52.433957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:52.444233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:52.446073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:52.446616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:52.447499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:52.448330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:52.449496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:52.647747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:52.656841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:52.658559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:52.659830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c17378c9-1ce7-425a-a421-85fe1763a82a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.238631 Sep 13 19:49:52.668189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 56/108] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:52 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:49:53.026653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-a51a3c50-891a-4893-86da-869a30b07b41 req-443113c2-619d-4b3b-b638-9351fb25bae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3965b308-7b06-4c6b-8cf6-a14e471c13b9", "tag": "7ef6f233-e8a9-46ca-913a-804b61bdeb70"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:53.058598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a51a3c50-891a-4893-86da-869a30b07b41 req-443113c2-619d-4b3b-b638-9351fb25bae2 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.059121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a51a3c50-891a-4893-86da-869a30b07b41 req-443113c2-619d-4b3b-b638-9351fb25bae2 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.059565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a51a3c50-891a-4893-86da-869a30b07b41 req-443113c2-619d-4b3b-b638-9351fb25bae2 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.086750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-a51a3c50-891a-4893-86da-869a30b07b41 req-443113c2-619d-4b3b-b638-9351fb25bae2 service nova] Creating event network-changed:7ef6f233-e8a9-46ca-913a-804b61bdeb70 for instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 on hv-cinder-82880 Sep 13 19:49:53.099975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-a51a3c50-891a-4893-86da-869a30b07b41 req-443113c2-619d-4b3b-b638-9351fb25bae2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083636 Sep 13 19:49:53.104347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 53/109] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:53.274486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:53.275126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:53.281268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.281790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.282406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.283091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.283546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.283964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.434371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:53.440108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:53.440921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:53.446083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-759f2484-c1a6-4ec4-8e17-61f2cc320f73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.175922 Sep 13 19:49:53.453940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 57/110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:53 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:53.454541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.455284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.456043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.457174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.457871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.458696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.688813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:53.689414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:53.703901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.703901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.703901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.703901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.704232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.704232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.784244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:53.786607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:53.803260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1eeaa8e4-4a7d-40d6-95d4-ccfd696782b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1554 microversion: 2.1 time: 0.373895 Sep 13 19:49:53.818181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 54/111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:53 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1554 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:53.837432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:53.839834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:53.858525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.859024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.859454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:53.862161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:53.862789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:53.864068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:54.025079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2c948047-8d5e-4888-a95d-f6b4bd9f9eb4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179967 Sep 13 19:49:54.025079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 55/112] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:49:53 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:49:54.025367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:54.033071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:54.034863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:54.036289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-66971ed5-985f-4b38-b6a8-54808b65a25d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1407 microversion: 2.20 time: 0.351432 Sep 13 19:49:54.046057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 58/113] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:53 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:54.478226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:54.479611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:54.485983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:54.486793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:54.487459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:54.488457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:54.489642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:54.490298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:54.864141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:54.882150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0d185b2a-52e1-4bed-8e63-ff5aa80e8319 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.408269 Sep 13 19:49:54.883811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:54 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:55.062859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:55.066064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:55.074165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.074778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.075554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:55.076238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.077163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.077901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:55.298016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:55.303638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-d4d7232d-5e38-474a-8bfb-cf784d482438 req-306723e4-f555-497c-9a10-ebbad15cedc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0", "tag": "002e649f-2cce-4efe-82ec-68136953168c"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:55.324684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:55.328806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:55.330976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e6f05d35-69ef-4563-9d1c-5bbce285ac88 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1598 microversion: 2.20 time: 0.272944 Sep 13 19:49:55.331246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d4d7232d-5e38-474a-8bfb-cf784d482438 req-306723e4-f555-497c-9a10-ebbad15cedc3 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.331738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d4d7232d-5e38-474a-8bfb-cf784d482438 req-306723e4-f555-497c-9a10-ebbad15cedc3 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.334128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-d4d7232d-5e38-474a-8bfb-cf784d482438 req-306723e4-f555-497c-9a10-ebbad15cedc3 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:55.346226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 59/115] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:49:55 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1598 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:55.351058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-d4d7232d-5e38-474a-8bfb-cf784d482438 req-306723e4-f555-497c-9a10-ebbad15cedc3 service nova] Creating event network-changed:002e649f-2cce-4efe-82ec-68136953168c for instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 on hv-cinder-82880 Sep 13 19:49:55.358289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-d4d7232d-5e38-474a-8bfb-cf784d482438 req-306723e4-f555-497c-9a10-ebbad15cedc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065271 Sep 13 19:49:55.360297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:55.362281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 57/116] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:49:55.362674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:55.370607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.371346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.371967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:55.373373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.374055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.375108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:55.513216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-06d23ac7-50ad-49ae-ab32-1c170bc6886f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.157847 Sep 13 19:49:55.514383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 60/117] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Sep 13 19:49:55 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:49:55.911051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:55.912335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:55.928215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.928715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.931246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:55.932190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:55.932922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:55.933521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:56.185356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:56.194748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d2afe390-bbe9-42c1-9c93-cdf6b8c04b87 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.290551 Sep 13 19:49:56.198154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 58/118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:55 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:57.218928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:57.220285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:57.228948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:57.229565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:57.230025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:57.230768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:57.231665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:57.232088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:57.377120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-78d824c3-886a-44a0-96ef-d2ff1cd018c1 req-a3ae3710-9835-4697-bd78-a029c2296110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:49:57.393289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-78d824c3-886a-44a0-96ef-d2ff1cd018c1 req-a3ae3710-9835-4697-bd78-a029c2296110 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:57.399048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-78d824c3-886a-44a0-96ef-d2ff1cd018c1 req-a3ae3710-9835-4697-bd78-a029c2296110 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:57.401775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-78d824c3-886a-44a0-96ef-d2ff1cd018c1 req-a3ae3710-9835-4697-bd78-a029c2296110 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:57.429522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-78d824c3-886a-44a0-96ef-d2ff1cd018c1 req-a3ae3710-9835-4697-bd78-a029c2296110 service nova] Creating event network-changed:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:49:57.451569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-78d824c3-886a-44a0-96ef-d2ff1cd018c1 req-a3ae3710-9835-4697-bd78-a029c2296110 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079757 Sep 13 19:49:57.455755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 59/119] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:49:57.561286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:57.575263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1aa896e2-e111-4b6f-bb26-68106e381c33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.361164 Sep 13 19:49:57.576352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 61/120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:57 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:58.605099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:58.606022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:58.621563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:58.622218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:58.622486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:58.623377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:58.623988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:58.628099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:58.931881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:58.943033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2005d02c-5ae2-4c85-a6d2-629adfc70a69 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.344757 Sep 13 19:49:58.944098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 60/121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:58 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:59.132131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:59.132626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:59.138408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:59.139511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:59.139949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:59.140632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:59.141073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:59.141489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:59.157343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:59.169968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:49:59.269296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0e98af21-030c-4e23-8913-d336a971bc87 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 204 len: 0 microversion: 2.1 time: 0.140772 Sep 13 19:49:59.270684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 62/122] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:49:59 2022] DELETE /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:49:59.279375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:59.279976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:59.286768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:59.287242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:59.287667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:59.288340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:59.288780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:59.289194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:59.429415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:49:59.438506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e2f5165f-16a2-4dd6-97f1-e4ec28a0586c tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.163474 Sep 13 19:49:59.439008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 61/123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:59 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:49:59.968370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:49:59.969060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:49:59.974937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:59.975411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:59.975841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:59.976521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:59.976964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:59.977387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:00.144461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:00.157703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-daa24342-ec64-4364-8bc9-8af6b233555d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.193599 Sep 13 19:50:00.158269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 63/124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:49:59 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:00.462936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:00.463544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:00.472790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:00.473683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:00.474314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:00.475763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:00.476642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:00.477137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:00.699215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:00.710360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-99fd6a57-a028-485c-b263-3dd591ccbe36 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.251486 Sep 13 19:50:00.711159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 62/125] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:00 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:01.185396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:01.186226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:01.193970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:01.194556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:01.195808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:01.196674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:01.197656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:01.198163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:01.370343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:01.381242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a871bfdb-72f0-4ab1-b9ae-02248daa06ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.201499 Sep 13 19:50:01.381852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 64/126] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:01 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:01.733859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:01.734773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:01.742903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:01.743702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:01.744531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:01.745522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:01.746176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:01.746653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:01.913426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:01.921958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-039b96aa-e346-4c9b-9ddc-479416184268 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.192032 Sep 13 19:50:01.922683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 63/127] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:01 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:02.404558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:02.405166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:02.415430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:02.415924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:02.416363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:02.417178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:02.418034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:02.418798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:02.564107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:02.572319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-50e79d6b-9275-47f3-ba73-15d7ec37910b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.171424 Sep 13 19:50:02.581656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 65/128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:02 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:02.946826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:02.947454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:02.953740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:02.954220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:02.954650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:02.955324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:02.955931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:02.956349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:03.091911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:03.100799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aefd9865-1d33-4c89-b90e-2f954e52ebed tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.157782 Sep 13 19:50:03.101374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 64/129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:02 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:03.595731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:03.596380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:03.603988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:03.603988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:03.603988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:03.604261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:03.604652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:03.605092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:03.739404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:03.748317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4fb06bcd-5ef9-4a3c-a306-780c2eabc12a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.156471 Sep 13 19:50:03.748881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 66/130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:03 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:04.124553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:04.125212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:04.131975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:04.132447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:04.132874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:04.133542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:04.134012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:04.134431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:04.273117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:04.281745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e8148d95-bc57-46d5-89dc-7a9969de7670 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.161030 Sep 13 19:50:04.282332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 65/131] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:04 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:04.772368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:04.772984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:04.778901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:04.779412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:04.779847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:04.780528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:04.780976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:04.781396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:04.911079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:04.918870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-09e49d91-81b7-4582-900c-e8d686676c4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.150954 Sep 13 19:50:04.919436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 67/132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:04 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:05.306530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:05.307418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:05.313783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:05.314254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:05.314678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:05.315345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:05.315786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:05.316198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:05.444337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:05.452595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5987cd41-6692-4918-b66b-0401def83192 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.149953 Sep 13 19:50:05.453154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:05 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:05.941542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:05.942188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:05.948095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:05.948594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:05.949026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:05.949727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:05.950174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:05.950624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:06.070382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-8ad2775a-4aa8-4833-be1f-5402ac44e1a2 req-65dadaf9-9460-498a-b99d-1cb784c3a01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc9b4dc-7483-40d5-ac35-1859f5477446", "name": "network-vif-unplugged", "status": "completed", "tag": "dcbc5d56-3611-4abe-ae9d-3f88fabaf774"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:06.081042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-8ad2775a-4aa8-4833-be1f-5402ac44e1a2 req-65dadaf9-9460-498a-b99d-1cb784c3a01f service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:06.081873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-8ad2775a-4aa8-4833-be1f-5402ac44e1a2 req-65dadaf9-9460-498a-b99d-1cb784c3a01f service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:06.082994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-8ad2775a-4aa8-4833-be1f-5402ac44e1a2 req-65dadaf9-9460-498a-b99d-1cb784c3a01f service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:06.095465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-8ad2775a-4aa8-4833-be1f-5402ac44e1a2 req-65dadaf9-9460-498a-b99d-1cb784c3a01f service nova] Creating event network-vif-unplugged:dcbc5d56-3611-4abe-ae9d-3f88fabaf774 for instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 on hv-cinder-82880 Sep 13 19:50:06.096130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:06.101143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-8ad2775a-4aa8-4833-be1f-5402ac44e1a2 req-65dadaf9-9460-498a-b99d-1cb784c3a01f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035296 Sep 13 19:50:06.101923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 67/134] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:06.106244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-35b75312-defe-4c89-bab3-e9fb33f4bc02 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.168385 Sep 13 19:50:06.107046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:05 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:06.476018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:06.476710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:06.482730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:06.483206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:06.483637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:06.484322 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:06.484773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:06.485190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:06.616346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:06.624448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7a9eb196-6115-422e-8c95-6930b6cf1688 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.153835 Sep 13 19:50:06.625007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:06 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:07.132057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:07.132660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:07.138517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:07.139000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:07.139433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:07.140110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:07.140558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:07.140979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:07.268971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:07.276714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-082045f1-440d-4a73-b7dd-f3790e4532f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.148998 Sep 13 19:50:07.277269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:07 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:07.647929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:07.648529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:07.654825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:07.655295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:07.655724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:07.656389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:07.656829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:07.657242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:07.785729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:07.793826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4915b87-8789-4a7a-b654-b24c20659492 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.150520 Sep 13 19:50:07.794386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 69/138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:07 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:08.298782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:08.299584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:08.305600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:08.306105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:08.306540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:08.307259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:08.307693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:08.308115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:08.432175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:08.439752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-14bf9f5a-0661-4951-acb8-f8a9b7414e11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.144912 Sep 13 19:50:08.440326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:08 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:08.816269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:08.817527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:08.823900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:08.824339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:08.824751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:08.825428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:08.825899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:08.826321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:08.952430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:08.960973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-65af5e7c-f0c3-4a66-a561-e5b99c03b5e2 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.148556 Sep 13 19:50:08.961542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:08 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:09.463799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:09.464403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:09.470320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:09.470798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:09.471233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:09.471907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:09.472354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:09.472774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:09.598414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:09.605982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-efe55501-1436-46bd-becf-64ab6ad866ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.145995 Sep 13 19:50:09.606551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:09 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:09.986562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:09.987869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:09.997948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:09.998761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:09.999206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:09.999927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:10.000473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:10.001259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:10.408286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:10.416719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-67be69db-350e-47e1-8fbd-d73191ba6903 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1553 microversion: 2.1 time: 0.435848 Sep 13 19:50:10.417507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:09 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1553 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:10.628569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:10.629982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:10.636303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:10.636885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:10.637445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:10.638374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:10.638832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:10.639258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:10.980597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:10.990667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e8bc3ea9-cfb7-471e-a833-46bb3b11d07c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.366066 Sep 13 19:50:10.991959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:10 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:11.046825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-e767f35d-d04f-4956-b527-1185e5fe678f req-67d5fd4f-d132-42f2-9fa0-a08aef747e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc9b4dc-7483-40d5-ac35-1859f5477446", "name": "network-vif-deleted", "tag": "dcbc5d56-3611-4abe-ae9d-3f88fabaf774"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:11.058803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-e767f35d-d04f-4956-b527-1185e5fe678f req-67d5fd4f-d132-42f2-9fa0-a08aef747e93 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:11.059283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-e767f35d-d04f-4956-b527-1185e5fe678f req-67d5fd4f-d132-42f2-9fa0-a08aef747e93 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:11.059945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-e767f35d-d04f-4956-b527-1185e5fe678f req-67d5fd4f-d132-42f2-9fa0-a08aef747e93 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:11.072760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-e767f35d-d04f-4956-b527-1185e5fe678f req-67d5fd4f-d132-42f2-9fa0-a08aef747e93 service nova] Creating event network-vif-deleted:dcbc5d56-3611-4abe-ae9d-3f88fabaf774 for instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 on hv-cinder-82880 Sep 13 19:50:11.079076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-e767f35d-d04f-4956-b527-1185e5fe678f req-67d5fd4f-d132-42f2-9fa0-a08aef747e93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036394 Sep 13 19:50:11.079993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 72/144] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:11.443507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:11.444369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:11.457746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:11.458304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:11.458938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:11.459741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:11.460309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:11.461093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:11.575287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:11.586621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1c663825-db23-4c6c-bc7d-b769ea98044e tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1345 microversion: 2.1 time: 0.148463 Sep 13 19:50:11.587784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 73/145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:11 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:12.015713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:12.016410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:12.023650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:12.024157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:12.024914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:12.025865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:12.026373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:12.026996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:12.207937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:12.216614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-14125d13-0b96-4555-82a9-5b5660a5521f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.205858 Sep 13 19:50:12.226918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:12 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:12.618328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:12.619023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:12.626244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:12.626807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:12.627298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:12.628081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:12.628551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:12.629683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:12.668588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:12.669066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:12.669674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:12.670142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lazy-loading 'fault' on Instance uuid 8dc9b4dc-7483-40d5-ac35-1859f5477446 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:50:12.724960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf74b3dd4c24c1aa3c0ac659b37c0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c073eb9c7a494ab879f3af8cc96717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:12.732771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-791bf29e-9bfd-4706-b08d-965037c5f6f8 tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 200 len: 1350 microversion: 2.1 time: 0.119883 Sep 13 19:50:12.733340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 74/147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:12 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:13.240783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:13.241392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:13.247785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:13.248264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:13.248696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:13.249408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:13.249880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:13.250302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:13.265426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:13.382990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:13.391045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d5fe641-cf58-449f-8cbf-8745c386966a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.155288 Sep 13 19:50:13.391709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:13 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:13.756925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:13.757589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:13.764220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:13.764923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:13.765381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:13.766252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:13.766848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:13.767416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:13.787995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] HTTP exception thrown: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Request method failure captured: Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 HTTP/1.1 Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN63sMNT7i5grIHd3WCWqBgDUNgqXDqHvGfbq4zOQT_waE8-I0h7bT1sqP37L2MMtS1N4DKJmHBBoYgAkfef6eYDSKxB9C6R059gBWwswAwZ_OT3IkMlJU0Jf-1Ywzf-GgJn0AgXtq6MWAU3iy7ve0oY-ktrsuri3Q8yafPWT2UxL4I Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:13.792937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 0cf74b3dd4c24c1aa3c0ac659b37c0e1 Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.794230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '8dc9b4dc-7483-40d5-ac35-1859f5477446'} Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:13.795054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.796128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.798769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Returning 404 to user: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:13.800541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bb65f48b-2df8-4d39-9763-f78cbf6fc20d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 404 len: 111 microversion: 2.1 time: 0.047616 Sep 13 19:50:13.801543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:13 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:13.924657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:13.926856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:13.933210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:13.933726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:13.934186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:13.934894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:13.935331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:13.935748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:13.949039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] HTTP exception thrown: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Request method failure captured: Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446/os-volume_attachments HTTP/1.1 Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN63sMNT7i5grIHd3WCWqBgDUNgqXDqHvGfbq4zOQT_waE8-I0h7bT1sqP37L2MMtS1N4DKJmHBBoYgAkfef6eYDSKxB9C6R059gBWwswAwZ_OT3IkMlJU0Jf-1Ywzf-GgJn0AgXtq6MWAU3iy7ve0oY-ktrsuri3Q8yafPWT2UxL4I Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:50:13.954160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 0cf74b3dd4c24c1aa3c0ac659b37c0e1 Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.955297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '8dc9b4dc-7483-40d5-ac35-1859f5477446'} Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:13.956054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:13.958201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:13.959311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Returning 404 to user: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:13.959311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-760920a1-fdbe-4e0d-a16b-64f739b5968d tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035114 Sep 13 19:50:13.959311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:50:13 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:14.416071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:14.416472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:14.426602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:14.427095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:14.427521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:14.428221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:14.428668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:14.429078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:14.611865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:14.627630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-143dc2e6-010a-4134-a633-8b0346d8eb76 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.216623 Sep 13 19:50:14.628367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:14 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:15.171765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:15.172444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:15.182094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:15.182830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:15.183434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:15.184284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:15.184910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:15.185650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:15.203660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] HTTP exception thrown: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Request method failure captured: Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 HTTP/1.1 Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN63sMNT7i5grIHd3WCWqBgDUNgqXDqHvGfbq4zOQT_waE8-I0h7bT1sqP37L2MMtS1N4DKJmHBBoYgAkfef6eYDSKxB9C6R059gBWwswAwZ_OT3IkMlJU0Jf-1Ywzf-GgJn0AgXtq6MWAU3iy7ve0oY-ktrsuri3Q8yafPWT2UxL4I Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:50:15.205837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 0cf74b3dd4c24c1aa3c0ac659b37c0e1 Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.207026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '8dc9b4dc-7483-40d5-ac35-1859f5477446'} Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:15.207662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.213549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Returning 404 to user: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:15.213549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f680092a-9b52-4c5d-a9b5-09c7261ae81b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 404 len: 111 microversion: 2.1 time: 0.041102 Sep 13 19:50:15.213549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 76/152] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:50:15 2022] DELETE /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:15.216276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:15.216882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] [instance: 8dc9b4dc-7483-40d5-ac35-1859f5477446] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:15.223538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:15.224019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:15.224618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:15.225571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:15.226052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:15.226479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:15.242683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] HTTP exception thrown: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Request method failure captured: Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 HTTP/1.1 Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN63sMNT7i5grIHd3WCWqBgDUNgqXDqHvGfbq4zOQT_waE8-I0h7bT1sqP37L2MMtS1N4DKJmHBBoYgAkfef6eYDSKxB9C6R059gBWwswAwZ_OT3IkMlJU0Jf-1Ywzf-GgJn0AgXtq6MWAU3iy7ve0oY-ktrsuri3Q8yafPWT2UxL4I Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:15.244792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f2c073eb9c7a494ab879f3af8cc96717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f2c073eb9c7a494ab879f3af8cc96717 Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-DeleteServersTestJSON-1866499159 Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 0cf74b3dd4c24c1aa3c0ac659b37c0e1 Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-DeleteServersTestJSON-1866499159-project Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.246430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '8dc9b4dc-7483-40d5-ac35-1859f5477446'} Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:15.247216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. Sep 13 19:50:15.248571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:15.249797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] Returning 404 to user: Instance 8dc9b4dc-7483-40d5-ac35-1859f5477446 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:15.249797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e4339650-2e2a-44dc-b46e-30c1307c329b tempest-DeleteServersTestJSON-1866499159 tempest-DeleteServersTestJSON-1866499159-project] 10.222.0.23 "GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446" status: 404 len: 111 microversion: 2.1 time: 0.034040 Sep 13 19:50:15.250502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 77/153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:15 2022] GET /compute/v2.1/servers/8dc9b4dc-7483-40d5-ac35-1859f5477446 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:15.653330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:15.653901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:15.661262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:15.661764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:15.662194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:15.662878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:15.663322 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:15.663745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:16.271793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:16.285751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9fc4e6cf-d56f-4427-b0d7-5501732fcc0b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.635401 Sep 13 19:50:16.286283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:15 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:17.308441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:17.308946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:17.316934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:17.319321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:17.320178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:17.323021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:17.326527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:17.327066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:17.354884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:17.599383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:17.619242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7a448c46-3af8-42a9-b151-08eb87d76e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.314342 Sep 13 19:50:17.625142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:17 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:18.653001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:18.654040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:18.664249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:18.664919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:18.665973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:18.667145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:18.667738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:18.668328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:18.932261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:18.943753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-38d42c96-fd19-4e50-95b5-ebc43c7302df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.295290 Sep 13 19:50:18.945035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 78/156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:18 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:19.972287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:19.972961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:19.975075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:20.001633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:20.002338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:20.002795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:20.005167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:20.007912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:20.008366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:20.262259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:20.272743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f3b861f2-c6c2-48a0-b780-34e85127fc8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.305118 Sep 13 19:50:20.274004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 79/157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:19 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:21.296768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.297300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:21.299896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=58 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:21.306683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:21.307492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:21.308140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:21.309036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:21.309759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:21.310384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:21.524747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:21.532938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-070b678f-0088-4d5b-8f4a-54ccc213327a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.240475 Sep 13 19:50:21.541644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 79/158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:21 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:21.569698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a53eebdd-1c44-4509-a5c7-9676085973e5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Action: 'create', calling method: .version_select at 0x7f676555d550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1099472055", "metadata": {"Type": "work"}}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a53eebdd-1c44-4509-a5c7-9676085973e5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Request method failure captured: Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 122 Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN79Vl6UTSSgG4898IvgBrKkY51An4Vh0p5tpQ64p3l3o7Z5VINgXneO5UIg_FzhJvHlFheZE1cgj1BahuaWnyqog1dPBwK74ZGSLxVe4G-j2fh6r1tQc6-_1iSYRPwgcnnS_T1K8O29MHMQNJDy4OsZCuX5jfMHHECCD4HWu4-eG_E Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:21.584443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: ff83f512018b4053bdf4653d1782d7bc Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1099472055", "metadata": {"Type": "work"}}} Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 19:50:21.585811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1099472055', 'metadata': {'Type': 'work'}}}} Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise error Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.586644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 19:50:21.587804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 19:50:21.588792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 19:50:21.588792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.588792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a53eebdd-1c44-4509-a5c7-9676085973e5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.588792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a53eebdd-1c44-4509-a5c7-9676085973e5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.202920 Sep 13 19:50:21.588792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 80/159] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 13 19:50:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 19:50:21.596246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71f23a6a-5739-4d75-97d5-3393322f9322 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Action: 'create', calling method: .version_select at 0x7f67653fb700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-127699639", "metadata": {"Type": "work"}}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71f23a6a-5739-4d75-97d5-3393322f9322 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Request method failure captured: Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 119 Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN79Vl6UTSSgG4898IvgBrKkY51An4Vh0p5tpQ64p3l3o7Z5VINgXneO5UIg_FzhJvHlFheZE1cgj1BahuaWnyqog1dPBwK74ZGSLxVe4G-j2fh6r1tQc6-_1iSYRPwgcnnS_T1K8O29MHMQNJDy4OsZCuX5jfMHHECCD4HWu4-eG_E Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:50:21.602150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: ff83f512018b4053bdf4653d1782d7bc Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-127699639", "metadata": {"Type": "work"}}} Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: Sep 13 19:50:21.603610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-127699639', 'metadata': {'Type': 'work'}}}} Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise error Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi '0' Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.604464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 19:50:21.605932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 19:50:21.607116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 19:50:21.607116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.608093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71f23a6a-5739-4d75-97d5-3393322f9322 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.609801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71f23a6a-5739-4d75-97d5-3393322f9322 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017011 Sep 13 19:50:21.611245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 80/160] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 13 19:50:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:50:21.620151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-89b4c1fc-cd23-4034-8dcc-8a3a90fe5b51 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Action: 'create', calling method: .version_select at 0x7f6765339700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1854733762", "metadata": {"Type": "work"}}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-89b4c1fc-cd23-4034-8dcc-8a3a90fe5b51 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Request method failure captured: Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 119 Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN79Vl6UTSSgG4898IvgBrKkY51An4Vh0p5tpQ64p3l3o7Z5VINgXneO5UIg_FzhJvHlFheZE1cgj1BahuaWnyqog1dPBwK74ZGSLxVe4G-j2fh6r1tQc6-_1iSYRPwgcnnS_T1K8O29MHMQNJDy4OsZCuX5jfMHHECCD4HWu4-eG_E Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:21.624397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: ff83f512018b4053bdf4653d1782d7bc Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1854733762", "metadata": {"Type": "work"}}} Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 19:50:21.625814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1854733762', 'metadata': {'Type': 'work'}}}} Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise error Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi '' Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.626685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 19:50:21.628343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 19:50:21.629888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 19:50:21.629888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.631932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-89b4c1fc-cd23-4034-8dcc-8a3a90fe5b51 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.633412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-89b4c1fc-cd23-4034-8dcc-8a3a90fe5b51 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017611 Sep 13 19:50:21.634678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 81/161] 10.222.0.23 () {60 vars in 1156 bytes} [Tue Sep 13 19:50:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:50:21.647187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2576dce1-c3d1-45f0-ae2a-990049f088a5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Calling method '.version_select at 0x7f67653de820>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.690894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-2576dce1-c3d1-45f0-ae2a-990049f088a5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] HTTP exception thrown: Volume tempest-invalid-964712627 could not be found. Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2576dce1-c3d1-45f0-ae2a-990049f088a5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Request method failure captured: Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-964712627 HTTP/1.1 Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN79Vl6UTSSgG4898IvgBrKkY51An4Vh0p5tpQ64p3l3o7Z5VINgXneO5UIg_FzhJvHlFheZE1cgj1BahuaWnyqog1dPBwK74ZGSLxVe4G-j2fh6r1tQc6-_1iSYRPwgcnnS_T1K8O29MHMQNJDy4OsZCuX5jfMHHECCD4HWu4-eG_E Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:50:21.694489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: ff83f512018b4053bdf4653d1782d7bc Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Volume tempest-invalid-964712627 could not be found. Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'tempest-invalid-964712627'} Sep 13 19:50:21.695832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-964712627 could not be found. (HTTP 404) (Request-ID: req-f6902868-8fd8-4a65-bdef-c66d9cb924c5) Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.696566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:50:21.697710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-964712627 could not be found. Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:21.698708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-964712627 could not be found. Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-964712627 could not be found. Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2576dce1-c3d1-45f0-ae2a-990049f088a5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Returning 404 to user: Volume tempest-invalid-964712627 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2576dce1-c3d1-45f0-ae2a-990049f088a5 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-964712627" status: 404 len: 98 microversion: 2.1 time: 0.056608 Sep 13 19:50:21.699815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1215 bytes} [Tue Sep 13 19:50:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-964712627 => generated 98 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 19:50:21.711352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c8c57d70-a5d6-4d2a-b099-ae04a32cca07 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003663 Sep 13 19:50:21.712528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Sep 13 19:50:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 19:50:21.720699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7af2a49a-80c0-4438-8c29-2d1bacad5502 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003740 Sep 13 19:50:21.725059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 82/164] 10.222.0.23 () {58 vars in 1137 bytes} [Tue Sep 13 19:50:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 19:50:21.737312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b70d977e-ae1f-4427-81c7-98e65ae09431 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Calling method '.version_select at 0x7f676604be50>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.775289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-b70d977e-ae1f-4427-81c7-98e65ae09431 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] HTTP exception thrown: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b70d977e-ae1f-4427-81c7-98e65ae09431 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Request method failure captured: Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-volumes/0a0182e1-12e7-46c2-a471-b9f444fdefca HTTP/1.1 Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN79Vl6UTSSgG4898IvgBrKkY51An4Vh0p5tpQ64p3l3o7Z5VINgXneO5UIg_FzhJvHlFheZE1cgj1BahuaWnyqog1dPBwK74ZGSLxVe4G-j2fh6r1tQc6-_1iSYRPwgcnnS_T1K8O29MHMQNJDy4OsZCuX5jfMHHECCD4HWu4-eG_E Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:21.777373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: ff83f512018b4053bdf4653d1782d7bc Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '0a0182e1-12e7-46c2-a471-b9f444fdefca'} Sep 13 19:50:21.778745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. (HTTP 404) (Request-ID: req-8ac848b2-62d9-4259-93b7-06c06dc50548) Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.779438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:50:21.780464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 19:50:21.781474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. Sep 13 19:50:21.782545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.785456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b70d977e-ae1f-4427-81c7-98e65ae09431 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Returning 404 to user: Volume 0a0182e1-12e7-46c2-a471-b9f444fdefca could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.786491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b70d977e-ae1f-4427-81c7-98e65ae09431 tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/0a0182e1-12e7-46c2-a471-b9f444fdefca" status: 404 len: 109 microversion: 2.1 time: 0.056284 Sep 13 19:50:21.787209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 83/165] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:50:21 2022] DELETE /compute/v2.1/os-volumes/0a0182e1-12e7-46c2-a471-b9f444fdefca => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:21.799775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-553943ea-7ba4-4c6c-b2f7-639aec679b4f tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Calling method '.version_select at 0x7f676542a0d0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.854900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-553943ea-7ba4-4c6c-b2f7-639aec679b4f tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] HTTP exception thrown: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-553943ea-7ba4-4c6c-b2f7-639aec679b4f tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Request method failure captured: Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/os-volumes/d06bfe61-944f-4b26-bb7c-e7cfdb30ceff HTTP/1.1 Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN79Vl6UTSSgG4898IvgBrKkY51An4Vh0p5tpQ64p3l3o7Z5VINgXneO5UIg_FzhJvHlFheZE1cgj1BahuaWnyqog1dPBwK74ZGSLxVe4G-j2fh6r1tQc6-_1iSYRPwgcnnS_T1K8O29MHMQNJDy4OsZCuX5jfMHHECCD4HWu4-eG_E Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:50:21.858124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f56d4e10297e42689603cf6cae0eeb40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f56d4e10297e42689603cf6cae0eeb40 Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesNegativeTest-1216132806 Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: ff83f512018b4053bdf4653d1782d7bc Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesNegativeTest-1216132806-project Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'd06bfe61-944f-4b26-bb7c-e7cfdb30ceff'} Sep 13 19:50:21.859531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. (HTTP 404) (Request-ID: req-ba50bf58-f56b-4dc2-b4c0-dd149d3f92a5) Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.860603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:21.862032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:50:21.865035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-553943ea-7ba4-4c6c-b2f7-639aec679b4f tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] Returning 404 to user: Volume d06bfe61-944f-4b26-bb7c-e7cfdb30ceff could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-553943ea-7ba4-4c6c-b2f7-639aec679b4f tempest-VolumesNegativeTest-1216132806 tempest-VolumesNegativeTest-1216132806-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d06bfe61-944f-4b26-bb7c-e7cfdb30ceff" status: 404 len: 109 microversion: 2.1 time: 0.065732 Sep 13 19:50:21.866262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 19:50:21 2022] GET /compute/v2.1/os-volumes/d06bfe61-944f-4b26-bb7c-e7cfdb30ceff => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:22.562313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:22.564399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:22.584140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:22.584742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:22.585151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:22.585904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:22.586875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:22.587319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:22.974880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:22.984383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c10ffd09-bd5c-45f2-95c6-192d691ee104 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.427898 Sep 13 19:50:22.985563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:22 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:24.009803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:24.029250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:24.037122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:24.037948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:24.038541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:24.039394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:24.040032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:24.040602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:24.232949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:24.241686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1a7c8385-4ba4-457b-b33a-ff39505b7ded tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.236472 Sep 13 19:50:24.243221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:24 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:25.266957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:25.274991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:25.301043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:25.302077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:25.302775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:25.303725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:25.304385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:25.305760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:25.528878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:25.541491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fba1b856-3d0a-4bda-8123-1c6f66f3b210 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1521 microversion: 2.1 time: 0.280521 Sep 13 19:50:25.542752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:25 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:26.572854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:26.575209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:26.586364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:26.588130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:26.589509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:26.591870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:26.593469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:26.594240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:26.857687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:26.869480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-26089422-013f-459f-b872-a38fe5c742f5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1501 microversion: 2.1 time: 0.301503 Sep 13 19:50:26.872432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:26 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1501 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:26.897427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:26.898172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:26.906307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:26.907025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:26.907627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:26.908973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:26.910780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:26.911480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:27.092171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:27.102022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a853d706-e29d-4ff3-9302-0e3fcb92abf5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1516 microversion: 2.1 time: 0.210885 Sep 13 19:50:27.103597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 86/171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:26 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:28.711357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:28.713700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:28.739392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:28.739883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:28.740320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:28.741105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:28.741554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:28.742004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:28.822373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'flavor' on Instance uuid dfc45d7f-3cb6-47cb-830f-222b9263297b {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:50:29.006037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4fb3c880-2c62-4bf1-a125-e8e03e2f066a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/action" status: 200 len: 32 microversion: 2.1 time: 0.299551 Sep 13 19:50:29.007668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 86/172] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:50:28 2022] POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:50:29.024396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:29.024999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:29.036430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:29.037348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:29.039323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:29.041700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:29.044852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:29.044852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:30.025539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:30.040047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bfc69941-1e42-40f6-af72-9cec37d2c599 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 1.019496 Sep 13 19:50:30.054584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 87/173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:29 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:31.076513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:31.077525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:31.095396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:31.097021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:31.098214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:31.099138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:31.099786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:31.100401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:31.435996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:31.445223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-267bd812-8207-40cd-b3bd-f1def7db4af3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.380115 Sep 13 19:50:31.446418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 87/174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:31 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:32.470615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:32.471168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:32.477374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:32.478124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:32.478738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:32.479727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:32.480524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:32.481140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:32.747505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:32.756393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0c1d3244-7fe2-4e3b-a7a2-065d9f5f9461 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.290520 Sep 13 19:50:32.769677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 88/175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:32 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:33.034299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1119799640", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "networks": [{"uuid": "d97d5ac9-e364-45fe-a690-c6e0eb942c3f"}]}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:33.109146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] validate_networks() for [('d97d5ac9-e364-45fe-a690-c6e0eb942c3f', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:33.500329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:33.501303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:33.502064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:33.502705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:33.503204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:33.515493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:33.516051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:33.516557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:33.517433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:33.517978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:33.518989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:33.533300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b6d24454-5ba7-489f-bc63-cd0cf0512ff0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Action: 'create', calling method: .version_select at 0x7f6765336d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-673951218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRCKIkOI169/mKGb0XeYpIS7A+qqtJAvIMAwFf1keZqiCTtZenx8SPKHa/28lCsjQgBd+fPo+xr8X0bjScKXK1cE7aLXdif8CIxJ7RcpRiv3CKjApLvYf3WZ3dLemma3A=="}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:33.537464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Getting quotas for project e1388306728a45e79823fa7e3156c33a. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:33.541782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Getting quotas for user ef7d925b638948649faedc030d14338f and project e1388306728a45e79823fa7e3156c33a. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:33.550464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-b6d24454-5ba7-489f-bc63-cd0cf0512ff0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Getting quotas for project 1f154705e31748d9b7b8455ee5f73b70. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:33.554706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:33.555655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-b6d24454-5ba7-489f-bc63-cd0cf0512ff0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Getting quotas for user 1e09b3554bb64828b857632d1de602d8 and project 1f154705e31748d9b7b8455ee5f73b70. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:33.557397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:33.586031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b6d24454-5ba7-489f-bc63-cd0cf0512ff0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.257777 Sep 13 19:50:33.587023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 89/176] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:50:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:33.621399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ce56638-cdd7-4945-a0f6-9d4bb7124f78 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591023 Sep 13 19:50:33.622505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 88/177] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:50:33.642711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4a6bf275-9b1c-4fb0-862e-bde9f6484024 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:33.653243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4a6bf275-9b1c-4fb0-862e-bde9f6484024 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:33.724384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4a6bf275-9b1c-4fb0-862e-bde9f6484024 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:33.742362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4a6bf275-9b1c-4fb0-862e-bde9f6484024 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1214 microversion: 2.1 time: 0.103221 Sep 13 19:50:33.746478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 90/178] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:33 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:33.781735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:33.782360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:33.797815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:33.797815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:33.799328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:33.801557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:33.805907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:33.807865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:34.350125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:34.363812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f61e9de9-ef70-4816-8a1e-adc1875cfaf7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.587175 Sep 13 19:50:34.365114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 89/179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:33 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:34.773386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:34.774029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:34.781151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:34.781755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:34.782089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:34.782827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:34.783495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:34.784110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:34.892170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:34.903987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c3feb839-6efd-4e7e-98ce-e04680a90883 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1266 microversion: 2.1 time: 0.136853 Sep 13 19:50:34.904590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 91/180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:34 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:35.387578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:35.388250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:35.395825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:35.396383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:35.396997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:35.397670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:35.398347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:35.398848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:35.609844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:35.618708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-06cab611-8e32-4e2f-a789-09648e2cf472 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.235307 Sep 13 19:50:35.619908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:35 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:35.928307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:35.928920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:35.944999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:35.948414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:35.949426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:35.952200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:35.952754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:35.953254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:36.212657 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:36.221070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-57c98f82-c7df-4480-a8fb-47d2edc6d5a4 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1314 microversion: 2.1 time: 0.297617 Sep 13 19:50:36.222381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:35 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:36.644750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:36.645450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:36.652512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:36.653128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:36.653709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:36.654602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:36.655083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:36.655556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:36.856726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:36.870475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-293fb28a-12d8-49c8-b29b-ae346654cfd0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.230579 Sep 13 19:50:36.871061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 91/183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:36 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:36.958858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-76647ed2-ea61-44cb-a983-02a5e7fdc9a6 req-bd897cf7-f9d7-423d-b7e9-75d4286e99ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bcb64f-30af-4df3-9084-f369a72b5c92", "tag": "eb684089-70bd-4266-b6f7-9cb121e30a04"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:36.970076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-76647ed2-ea61-44cb-a983-02a5e7fdc9a6 req-bd897cf7-f9d7-423d-b7e9-75d4286e99ff service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:36.970787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-76647ed2-ea61-44cb-a983-02a5e7fdc9a6 req-bd897cf7-f9d7-423d-b7e9-75d4286e99ff service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:36.971893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-76647ed2-ea61-44cb-a983-02a5e7fdc9a6 req-bd897cf7-f9d7-423d-b7e9-75d4286e99ff service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:36.997702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-76647ed2-ea61-44cb-a983-02a5e7fdc9a6 req-bd897cf7-f9d7-423d-b7e9-75d4286e99ff service nova] Creating event network-changed:eb684089-70bd-4266-b6f7-9cb121e30a04 for instance 54bcb64f-30af-4df3-9084-f369a72b5c92 on hv-cinder-82880 Sep 13 19:50:37.007408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-76647ed2-ea61-44cb-a983-02a5e7fdc9a6 req-bd897cf7-f9d7-423d-b7e9-75d4286e99ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052521 Sep 13 19:50:37.008441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 93/184] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:37.247502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:37.248374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:37.254305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:37.254783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:37.255208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:37.255880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:37.256324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:37.256738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:37.472732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:37.480627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8c7d8a9c-cd73-4168-87a8-960b751ad6ea tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1314 microversion: 2.1 time: 0.237067 Sep 13 19:50:37.490672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 92/185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:37 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:37.894363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:37.895194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:37.901832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:37.902214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:37.902902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:37.903822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:37.904484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:37.905127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:38.043432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:38.052161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d77b38a4-21af-481c-878e-8599ac89afb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.162327 Sep 13 19:50:38.052745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 94/186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:37 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:38.503743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:38.505122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:38.512104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:38.512596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:38.513035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:38.513758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:38.514213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:38.514633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:38.648482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:38.657832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-012a943f-6924-4829-b402-5d453515d010 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1314 microversion: 2.1 time: 0.157491 Sep 13 19:50:38.659681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 93/187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:38 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:39.078464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:39.079812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:39.086195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.086856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.087383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.088306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.089005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.089578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.335786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:39.349586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-966ead65-ed40-4a03-bf18-33e988dc97f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.276792 Sep 13 19:50:39.350282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 95/188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:39 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:39.681958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:39.682473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:39.688783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.689256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.689713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.690385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.690823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.691235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.829957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:39.838169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ad2490ef-bf61-4fea-9de4-b4fef7f9ebc2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1314 microversion: 2.1 time: 0.160172 Sep 13 19:50:39.838735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 94/189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:39 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:40.275978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:40.276484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:40.282540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.283024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.286619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.286619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.286619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.286619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.309223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1caeb2c8-755a-4700-a92d-29c445a9b764 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/ips" status: 200 len: 147 microversion: 2.1 time: 0.037143 Sep 13 19:50:40.309921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 96/190] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:50:40 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:40.372536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:40.373137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:40.379188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.379673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.380108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.380793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.381245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.381699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.384367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:40.518506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:40.526181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2d748d04-dffc-4c4f-a12d-17238ed5bd9d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.157505 Sep 13 19:50:40.526678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 95/191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:40 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:40.860193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:40.860826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:40.866704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.867181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.867612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.868285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.868728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.869148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:41.005035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:41.012939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1acb478c-7413-4177-a4fe-946b15196e95 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1314 microversion: 2.1 time: 0.156499 Sep 13 19:50:41.013514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 97/192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:40 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:41.317771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-f4ac1b71-8b0a-4de4-bfdb-1df9e0c6be58 req-1680af32-c2b1-46cd-ad2a-3bd3217c071f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bcb64f-30af-4df3-9084-f369a72b5c92", "name": "network-vif-plugged", "status": "completed", "tag": "eb684089-70bd-4266-b6f7-9cb121e30a04"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:41.329473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f4ac1b71-8b0a-4de4-bfdb-1df9e0c6be58 req-1680af32-c2b1-46cd-ad2a-3bd3217c071f service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:41.331319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f4ac1b71-8b0a-4de4-bfdb-1df9e0c6be58 req-1680af32-c2b1-46cd-ad2a-3bd3217c071f service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:41.331762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f4ac1b71-8b0a-4de4-bfdb-1df9e0c6be58 req-1680af32-c2b1-46cd-ad2a-3bd3217c071f service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:41.343739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-f4ac1b71-8b0a-4de4-bfdb-1df9e0c6be58 req-1680af32-c2b1-46cd-ad2a-3bd3217c071f service nova] Creating event network-vif-plugged:eb684089-70bd-4266-b6f7-9cb121e30a04 for instance 54bcb64f-30af-4df3-9084-f369a72b5c92 on hv-cinder-82880 Sep 13 19:50:41.348203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-f4ac1b71-8b0a-4de4-bfdb-1df9e0c6be58 req-1680af32-c2b1-46cd-ad2a-3bd3217c071f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 Sep 13 19:50:41.348823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 96/193] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:41.548806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:41.549506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:41.555804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:41.556215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:41.556656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:41.557348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:41.557830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:41.558254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:41.694007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:41.701516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2904472c-09be-4e07-be60-b163185017dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.157164 Sep 13 19:50:41.702099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 98/194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:41 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:42.036867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:42.037534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:42.043726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:42.044205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:42.044642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:42.045323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:42.045813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:42.046242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:42.185512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:42.193129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6e82b516-f0e7-4bc3-aa7e-5c7599f2a94d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1314 microversion: 2.1 time: 0.160534 Sep 13 19:50:42.193707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 97/195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:42 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:42.726643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:42.727225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:42.733076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:42.733554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:42.734015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:42.734682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:42.735123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:42.735538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:42.868894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:42.876915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-174c75c6-0a46-4f49-a9f7-d59e1869fb66 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.155057 Sep 13 19:50:42.877598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 99/196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:42 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:43.215314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.215912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:43.222338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.222817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.223381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.223989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.224637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.225848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.355283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:43.363342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a8e103b4-f4a4-4293-81bb-5a2a3d3d3276 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1498 microversion: 2.1 time: 0.151808 Sep 13 19:50:43.364054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 98/197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:43 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:43.898944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=6 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.904359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.905154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:43.911831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.912311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.912738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.913426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.913891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.914311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.944177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.944663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:43.946714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.947383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.953586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.954101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.954535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.955266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.956252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.956676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.983828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:50:44.060245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.069500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-946bb4a3-2521-49e9-b903-76117b842d01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.172254 Sep 13 19:50:44.070459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 100/198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:43 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:44.077359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b42d9713-7697-4a4d-9bb5-3e09b08783f2 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 204 len: 0 microversion: 2.1 time: 0.136457 Sep 13 19:50:44.078067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 99/199] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:50:43 2022] DELETE /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 19:50:44.087247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:44.087950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:44.094463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:44.094948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:44.095398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:44.096114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:44.096550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:44.096961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:44.228471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.236081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-82113ea5-9ac9-4c72-b51f-3938ae894b1d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1504 microversion: 2.1 time: 0.153348 Sep 13 19:50:44.236647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 101/200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:44 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:45.100273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:45.101046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:45.107058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.107531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.107961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.108633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.109074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.109485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.248443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:45.258554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6e727b09-fb73-4d5b-874f-05da82a49959 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.163015 Sep 13 19:50:45.259454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 100/201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:45 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:45.260121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:45.260948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:45.266908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.267381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.268062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.268740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.269182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.269595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.272567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:45.440407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:45.448079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0a3324b6-ccbd-4417-a905-6e8d78b26380 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1504 microversion: 2.1 time: 0.192227 Sep 13 19:50:45.448656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 102/202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:45 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:46.283080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:46.283588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:46.289980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.290480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.290915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.291647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.292101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.292526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.459214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "112fd7a0-5b11-48f8-b2b6-3cb80b02c930"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:46.461511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:46.469764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.470255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.471523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.472259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.472715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.473131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.526018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.534260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-48c65ca6-85a2-41c3-822c-d36a593ae936 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.255049 Sep 13 19:50:46.535168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 101/203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:46 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:46.541074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:46.541708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:46.547457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.548409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.549546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.550761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.551414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.551875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.755210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.763760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0e6c0e41-78a4-451a-8fd4-eda486d74bba tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 200 len: 1504 microversion: 2.1 time: 0.227306 Sep 13 19:50:46.764353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:46 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:46.879996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-ead487c0-44e1-43f1-a124-90477c71f636 req-da8f6efc-3010-4316-899a-56b1c14ef1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bcb64f-30af-4df3-9084-f369a72b5c92", "name": "network-vif-deleted", "tag": "eb684089-70bd-4266-b6f7-9cb121e30a04"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:46.894409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-ead487c0-44e1-43f1-a124-90477c71f636 req-da8f6efc-3010-4316-899a-56b1c14ef1aa service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.895132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-ead487c0-44e1-43f1-a124-90477c71f636 req-da8f6efc-3010-4316-899a-56b1c14ef1aa service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.895714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-ead487c0-44e1-43f1-a124-90477c71f636 req-da8f6efc-3010-4316-899a-56b1c14ef1aa service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.917460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-ead487c0-44e1-43f1-a124-90477c71f636 req-da8f6efc-3010-4316-899a-56b1c14ef1aa service nova] Creating event network-vif-deleted:eb684089-70bd-4266-b6f7-9cb121e30a04 for instance 54bcb64f-30af-4df3-9084-f369a72b5c92 on hv-cinder-82880 Sep 13 19:50:46.924263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-ead487c0-44e1-43f1-a124-90477c71f636 req-da8f6efc-3010-4316-899a-56b1c14ef1aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048451 Sep 13 19:50:46.924861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 103/205] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:46.935105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b69f4e83-cb9d-4bca-8478-3b57a892838b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480212 Sep 13 19:50:46.941572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 103/206] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:50:46 2022] POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-volume_attachments => generated 194 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:47.561237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:47.561884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:47.568969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.569559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.570013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.570852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.571302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.571725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.717171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.725553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0fe80675-2317-49f0-bf11-2992533a667e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.168729 Sep 13 19:50:47.726189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 104/207] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:47 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:47.790963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:47.791658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: 54bcb64f-30af-4df3-9084-f369a72b5c92] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:47.799279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.799753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.800203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.800879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.801319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.801764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.817265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] HTTP exception thrown: Instance 54bcb64f-30af-4df3-9084-f369a72b5c92 could not be found. Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Request method failure captured: Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 HTTP/1.1 Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN8HOOqzgBzmAplpU7RcHiU7m85ypaAGdQo3gaLNxI5Qa0pnBZrBmLMgqAWauMrgwvpcVVycV3IMxrF3P8CtoQyv-0cKCrFJM7uweyTy1FLQGaRcc9-4v1xzqNXdc24mVgZYTyAf2tIzZ0IHs5_kRIOoZbtlE5LwuC6Jc7WGjbPDKvw Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: e1388306728a45e79823fa7e3156c33a Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesActionsTest-1274216456 Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:47.818916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1388306728a45e79823fa7e3156c33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e1388306728a45e79823fa7e3156c33a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1388306728a45e79823fa7e3156c33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e1388306728a45e79823fa7e3156c33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesActionsTest-1274216456 Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: e1388306728a45e79823fa7e3156c33a Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesActionsTest-1274216456 Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesActionsTest-1274216456-project Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: ef7d925b638948649faedc030d14338f Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesActionsTest-1274216456-project Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 54bcb64f-30af-4df3-9084-f369a72b5c92 could not be found. Sep 13 19:50:47.820458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '54bcb64f-30af-4df3-9084-f369a72b5c92'} Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bcb64f-30af-4df3-9084-f369a72b5c92 could not be found. Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:47.821758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bcb64f-30af-4df3-9084-f369a72b5c92 could not be found. Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bcb64f-30af-4df3-9084-f369a72b5c92 could not be found. Sep 13 19:50:47.823223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:47.824514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Returning 404 to user: Instance 54bcb64f-30af-4df3-9084-f369a72b5c92 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:47.824514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-778db520-04b9-40df-a059-b08b21bb9670 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92" status: 404 len: 111 microversion: 2.1 time: 0.033579 Sep 13 19:50:47.824514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 104/208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:47 2022] GET /compute/v2.1/servers/54bcb64f-30af-4df3-9084-f369a72b5c92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:47.874067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2054634962", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "networks": [{"uuid": "d97d5ac9-e364-45fe-a690-c6e0eb942c3f"}]}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:47.932337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] validate_networks() for [('d97d5ac9-e364-45fe-a690-c6e0eb942c3f', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:48.487503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:48.487918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:48.488422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:48.489066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:48.489699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:48.498774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.499253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.499682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.500397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.500842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.501325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.518549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Getting quotas for project e1388306728a45e79823fa7e3156c33a. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:48.522423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Getting quotas for user ef7d925b638948649faedc030d14338f and project e1388306728a45e79823fa7e3156c33a. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:48.533201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:48.535501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:48.580563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dc2c6413-1369-48b6-819b-f0c2bb529f66 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710730 Sep 13 19:50:48.581659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 105/209] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:50:48.592893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a4475ee-4f35-47f0-b0d9-ef150889c3ed tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.593519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0a4475ee-4f35-47f0-b0d9-ef150889c3ed tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:48.650701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a4475ee-4f35-47f0-b0d9-ef150889c3ed tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.657535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0a4475ee-4f35-47f0-b0d9-ef150889c3ed tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1214 microversion: 2.1 time: 0.068532 Sep 13 19:50:48.658412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 105/210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:48.750257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.750861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:48.757069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.757489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.758032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.758717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.759172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.759599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.908766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.916505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-92d51abb-6139-4911-956e-66274d7e7cf6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.170092 Sep 13 19:50:48.917074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 106/211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:49.680810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.681408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.688518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.688995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.689488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.690213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.690726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.691149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.723004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.723552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.730824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.731406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.732070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.732771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.733285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.733740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.754543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:49.759392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a6d38e87-2c15-4b0a-96ee-2a499de13278 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/ips" status: 200 len: 148 microversion: 2.1 time: 0.040923 Sep 13 19:50:49.760180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 107/212] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:49.762587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-14503e4f-2cc7-4fc1-b014-fbcc3f77690f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1266 microversion: 2.1 time: 0.085593 Sep 13 19:50:49.763139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 106/213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:49.941240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.941983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.948362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.948920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.949421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.950439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.950919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.951415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:50.214045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:50.222740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-51ba3a37-a9ca-47e5-9393-275e9be60946 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.286166 Sep 13 19:50:50.223398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 108/214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:50.789658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:50.790273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:50.792927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:50.799375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:50.800036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:50.800469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:50.801162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:50.802254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:50.802666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.014702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.023194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eebc7317-6a33-4917-a848-30d53c1388d7 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.237699 Sep 13 19:50:51.024115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 107/215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:50 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:51.190371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87dd2454-6300-43a3-8472-5add0ec790da"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:51.192939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:51.199442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.200004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.200501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.201265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.201736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.202154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.245426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:51.246492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:51.254307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.255161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.255666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.256432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.257042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.257528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.505078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.514128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-adf3b3c4-09d2-4956-9c7c-6daa3535bf13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.272516 Sep 13 19:50:51.530039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 108/216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:51 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:51.530381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4c81808-3e22-4da4-b14b-cf21426a832e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344568 Sep 13 19:50:51.531062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 109/217] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:50:51 2022] POST /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:51.695948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-aea5cfd1-578c-4afc-aa90-c3e0bd4f468d req-0818d1ae-97ea-4686-a371-c36d1d57985e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07273ab-250e-4699-a1ba-7f6b264b2d14", "tag": "8ab37ad3-9454-4510-8c8e-1cbadacef101"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:51.705633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-aea5cfd1-578c-4afc-aa90-c3e0bd4f468d req-0818d1ae-97ea-4686-a371-c36d1d57985e service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.706208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-aea5cfd1-578c-4afc-aa90-c3e0bd4f468d req-0818d1ae-97ea-4686-a371-c36d1d57985e service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.706702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-aea5cfd1-578c-4afc-aa90-c3e0bd4f468d req-0818d1ae-97ea-4686-a371-c36d1d57985e service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.717407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-aea5cfd1-578c-4afc-aa90-c3e0bd4f468d req-0818d1ae-97ea-4686-a371-c36d1d57985e service nova] Creating event network-changed:8ab37ad3-9454-4510-8c8e-1cbadacef101 for instance f07273ab-250e-4699-a1ba-7f6b264b2d14 on hv-cinder-82880 Sep 13 19:50:51.722033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-aea5cfd1-578c-4afc-aa90-c3e0bd4f468d req-0818d1ae-97ea-4686-a371-c36d1d57985e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029899 Sep 13 19:50:51.722619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 109/218] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:52.052155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:52.052841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:52.054783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:52.060255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.060727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.061151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.061852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.062432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.062849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.197500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:52.205766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e9278155-031f-4f08-83c5-f7af5d25c9e1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.158951 Sep 13 19:50:52.206602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 110/219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:52 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:52.538059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:52.538666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:52.545174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.545695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.546133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.546840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.547308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.548076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.724333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:52.732419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3e2e51ac-55f5-4bfb-ae04-d86c482a783f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.199049 Sep 13 19:50:52.735521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 110/220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:52 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:53.080725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:53.081214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:53.088355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.089511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.090366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.090951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.091457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.091876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.097694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.123369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4706c105-faa8-4f66-9028-d56e604e7fcd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/ips" status: 200 len: 151 microversion: 2.20 time: 0.046606 Sep 13 19:50:53.131165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 111/221] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Sep 13 19:50:53 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:50:53.228738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:53.229338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:53.236873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.237422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.238050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.239069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.239673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.241242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.420064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.430046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d9677eb7-6375-49dc-b160-725a9b0d969b tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.204931 Sep 13 19:50:53.430713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 111/222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:53 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:53.758861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:53.759474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:53.765893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.766376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.766812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.767489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.767940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.768363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.907751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.915850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-10efa9ad-7474-46ed-adea-88d151ac5fb1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.161136 Sep 13 19:50:53.916414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 112/223] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:53 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:54.453274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:54.454445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:54.467265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.469054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.470133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.473196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.474130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.474559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.644038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71b97331-eb92-4399-9c6c-5c706eaa7175 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:54.651040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b97331-eb92-4399-9c6c-5c706eaa7175 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.651719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b97331-eb92-4399-9c6c-5c706eaa7175 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.652159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b97331-eb92-4399-9c6c-5c706eaa7175 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.684427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.693667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e6dea09c-dc4b-43b4-9451-62d411b9f59a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.245012 Sep 13 19:50:54.694661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 112/224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:54 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:54.720434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-71b97331-eb92-4399-9c6c-5c706eaa7175 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Going to try to stop instance {{(pid=127487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 19:50:54.773545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71b97331-eb92-4399-9c6c-5c706eaa7175 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action" status: 202 len: 0 microversion: 2.1 time: 0.133498 Sep 13 19:50:54.774262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 113/225] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:50:54 2022] POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:50:54.784929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:54.786440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:54.796732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.800101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.800770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.801599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.802272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.802764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.942078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:54.942759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:54.944391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.949112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.949601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.950086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.950778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.951286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.951710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.953407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f006f1a4-be8d-434d-90a7-b2e4b184481c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.174742 Sep 13 19:50:54.954580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 113/226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:54 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:55.102067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:55.109512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5f8eed69-3966-4f6e-bbe2-f1b821be1cce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.172938 Sep 13 19:50:55.110253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 114/227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:54 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:55.643399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:55.643934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:55.650423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.650903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.651337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.652018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.652457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.652874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.721317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:55.721962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:55.729051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.729451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.729929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.730629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.731077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.731489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.815801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lazy-loading 'flavor' on Instance uuid c34b27c6-038e-4f56-80f6-2c4d987b43e4 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:50:55.885125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:55.894459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d17e6ea5-3674-48ed-b84f-069dfe4ed949 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.177843 Sep 13 19:50:55.895884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 115/228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:55 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:55.976058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:55.976657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:55.983029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.983455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.983885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.984781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.985166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.985591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.101384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-83446429-38c0-45ec-9f17-cc98a75524d7 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/action" status: 202 len: 0 microversion: 2.20 time: 0.463027 Sep 13 19:50:56.102300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 114/229] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Sep 13 19:50:55 2022] POST /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:50:56.111951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.112635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.120912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.121813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.122322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.123050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.123495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.123911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.358954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.368375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4b450bc2-73b9-44db-83ef-3e219c8d0196 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.396091 Sep 13 19:50:56.369224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 116/230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:55 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:56.374294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.375939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.380898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.381383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.381845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.382521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.383207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.383859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.485264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.494315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.496007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.497286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dd9b81a5-5516-4f2d-9b28-d64b7e4ab930 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.390651 Sep 13 19:50:56.497954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 115/231] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:50:56.536625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.544855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3d18a904-1c43-4c77-96d1-79c25c211ea9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1502 microversion: 2.1 time: 0.174618 Sep 13 19:50:56.545433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 117/232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:56.569671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "732397b6-452b-4531-b5eb-e0e8406eef99"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:56.571984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.577898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.578383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.578829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.579542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.579989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.580412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.605736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Cannot 'attach_volume' instance dfc45d7f-3cb6-47cb-830f-222b9263297b while it is in vm_state rescued Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/os-volume_attachments HTTP/1.1 Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 74 Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:50:56.607426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {"volumeAttachment": {"volumeId": "732397b6-452b-4531-b5eb-e0e8406eef99"}} Sep 13 19:50:56.608934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Cannot 'attach_volume' instance dfc45d7f-3cb6-47cb-830f-222b9263297b while it is in vm_state rescued Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': 'dfc45d7f-3cb6-47cb-830f-222b9263297b', 'body': {'volumeAttachment': {'volumeId': '732397b6-452b-4531-b5eb-e0e8406eef99'}}} Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:56.613939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dfc45d7f-3cb6-47cb-830f-222b9263297b while it is in vm_state rescued Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:56.615203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dfc45d7f-3cb6-47cb-830f-222b9263297b while it is in vm_state rescued Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 409 to user: Cannot 'attach_volume' instance dfc45d7f-3cb6-47cb-830f-222b9263297b while it is in vm_state rescued {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e1dc0122-bbe0-41b3-a97f-487194bf1750 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043467 Sep 13 19:50:56.616252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 116/233] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:50:56 2022] POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 19:50:56.618678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:56.619204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.625030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.625506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.625968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.627318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.627932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.628536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.696978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ee0a2f3f-5ccd-4d5c-b0ec-50ce58b75e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/action" status: 202 len: 0 microversion: 2.1 time: 0.081984 Sep 13 19:50:56.697621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 118/234] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:50:56 2022] POST /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:50:56.706423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.707112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.716068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.716539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.716969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.717701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.718150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.718570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.848665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.856200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a990b3a7-5656-4195-8399-af6efb46020c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.154238 Sep 13 19:50:56.856749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 117/235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:56.918855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.919577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.925829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.926310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.926739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.927415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.928096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.928541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.065673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:57.073268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-14176c8c-ee9b-48a1-91fe-9ec66307d2a9 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.159160 Sep 13 19:50:57.073858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 119/236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:57.393348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:57.394002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:57.400350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.400922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.401416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.402453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.403107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.403595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.406549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:57.524433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:57.525337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:57.532185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.533849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.534866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.535768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.536405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.537012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.574921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:57.583937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-79a6cb22-1861-4ef0-aace-b039e76c431a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.195994 Sep 13 19:50:57.584866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 118/237] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:57 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:57.769046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:57.777258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:57.778737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:57.779898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bfe86833-3594-499f-bef4-6d4d8436b772 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.259698 Sep 13 19:50:57.780456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 120/238] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:57 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:57.879264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:57.880737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:57.887610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.888450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.889129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.889983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.890640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.891306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.033258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.041392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e32c052a-e788-46d8-a3fb-c20212d98194 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.166121 Sep 13 19:50:58.042265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 119/239] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:57 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:58.096675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:58.097203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-93b210bb-a9e6-41ab-bfda-2db19e52f5bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: .version_select at 0x7f67654a31f0>, body: {"keypair": {"name": "tempest-keypair-637734688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpxA795nXq61lKo+jUrP7dgHtfdyv6BEZRwFeBvNvdJ0m7DU4WjvDOI5EQeqF4XY7EESZs7i44C1NiyeeWAGQdkVKNBgT9S9YdNEDi1dtY7HCrI8KZmTUpDq1eY5TvMpQ=="}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:58.097312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:58.104008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.104875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.105706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.106591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.107932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.108721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.113473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-93b210bb-a9e6-41ab-bfda-2db19e52f5bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:58.117877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-93b210bb-a9e6-41ab-bfda-2db19e52f5bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:58.141796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-93b210bb-a9e6-41ab-bfda-2db19e52f5bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049423 Sep 13 19:50:58.142573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 120/240] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:50:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:58.249425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.257415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-303e197a-fd6f-4cc7-901a-db6c7edf6156 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.165133 Sep 13 19:50:58.258094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 121/241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:58 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:58.607046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:58.608184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:58.615177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.615674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.616109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.616814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.617269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.617722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.755054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.763916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-945cbfbc-0126-4631-bb39-ea71208b2f3c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.160824 Sep 13 19:50:58.764542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 121/242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:58 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:58.811026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:58.811619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:58.813563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:58.814250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:58.820174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.820651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.821075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.821781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.822220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.822632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.983242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.992735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.994258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.995534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f5736ce1-c9da-44ce-bca5-2b1e742a9bf8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.188427 Sep 13 19:50:58.996281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 122/243] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:58 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:50:59.065350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:59.066561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:59.073190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.073711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.074155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.074853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.075339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.075762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.217465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.225283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de7690ae-3d04-46d7-a48b-27020df79bbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.164796 Sep 13 19:50:59.225890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 122/244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:59 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:59.282001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:59.282609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:59.289234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.289752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.290191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.290876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.291326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.291975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.421687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.430152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e4fb8d58-b4d2-4157-ac8f-e50b6a6f3284 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.152209 Sep 13 19:50:59.430806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:59 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:59.540745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-526973321", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35be4e76-9541-4147-ba24-d2a973f5a0c4"}], "security_groups": [{"name": "tempest-securitygroup--1720873936"}], "key_name": "tempest-keypair-637734688", "user_data": "}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:59.650796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] validate_networks() for [('35be4e76-9541-4147-ba24-d2a973f5a0c4', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:59.786920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:59.787524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:59.793401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.793918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.794353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.795041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.795495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.795919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.061980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.070886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0340896a-41bf-4c25-8ddb-c2ce274f8a29 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.287709 Sep 13 19:51:00.071584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 124/246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:59 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:00.076109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.076779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.083108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.083660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.084164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.084925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.085588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.086197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.213182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:51:00.213750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:51:00.214261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:51:00.214739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:51:00.215249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:51:00.224090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.224668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.225110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.225869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.226322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.226747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.237925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.244115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:51:00.246081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.247521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.248414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:51:00.248664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a83bbe53-601a-4ef3-93d5-39ab67dd2a6e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.176115 Sep 13 19:51:00.249223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 125/247] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:00.258749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.259520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.260432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:51:00.262780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:51:00.265098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.265573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.266038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.266767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.267787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.268158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.272424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:00.311316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3800164c-c58a-4d5a-8903-35b10abdf755 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.774906 Sep 13 19:51:00.312236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 123/248] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:51:00.324187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a23d18b9-0e2d-4fec-8a17-082362d36a31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.324807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a23d18b9-0e2d-4fec-8a17-082362d36a31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.388386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a23d18b9-0e2d-4fec-8a17-082362d36a31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.398907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a23d18b9-0e2d-4fec-8a17-082362d36a31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1240 microversion: 2.1 time: 0.078777 Sep 13 19:51:00.400012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 124/249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:00.432538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.440769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-629b9b16-ec3e-4865-90e8-d19252963c2b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.185844 Sep 13 19:51:00.441379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 126/250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:00.454987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.455735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.461947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.462439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.462873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.463560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.464038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.464456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.605878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.614179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-89b0cb55-aff8-4b18-bcda-9f8a5f8587eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.163444 Sep 13 19:51:00.615192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 125/251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:01.095882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.096483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.103068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.103489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.103915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.104589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.105046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.105441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.247594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.256008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f7718f83-c014-4905-bd26-ae9cc06afbde tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.164845 Sep 13 19:51:01.256628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 127/252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:01.274367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.274973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.281287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.281813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.282282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.283531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.283987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.284414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.419384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.421547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.422285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.427899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.428711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.429185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.429346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.429636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.430315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.430519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-06b156fa-3bec-4a5d-9b87-9356d6b8b03c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.160041 Sep 13 19:51:01.430766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.431078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 126/253] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:01.431206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.463225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.463824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.469930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.470928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.471358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.472267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.472715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.473134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.496566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.504817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aedc1d4d-f5b1-400a-af5c-c5f72abb51c3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1292 microversion: 2.1 time: 0.087383 Sep 13 19:51:01.505485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 128/254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:01.605919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.614262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ccab0465-b73b-404f-945e-b22992864cda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.155022 Sep 13 19:51:01.614824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 127/255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:01.636143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.636764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.642829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.643384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.643813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.644487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.644925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.645404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.779636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.789403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5b689172-d13d-41a6-97a4-a790bb0ffca1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.156850 Sep 13 19:51:01.790656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 129/256] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:02.011388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-5b860964-7060-440c-8687-c14831256af1 req-4d80075c-674d-42bf-bf58-33707ae2d6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07273ab-250e-4699-a1ba-7f6b264b2d14", "name": "network-vif-plugged", "status": "completed", "tag": "8ab37ad3-9454-4510-8c8e-1cbadacef101"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:02.022887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-5b860964-7060-440c-8687-c14831256af1 req-4d80075c-674d-42bf-bf58-33707ae2d6eb service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.023374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-5b860964-7060-440c-8687-c14831256af1 req-4d80075c-674d-42bf-bf58-33707ae2d6eb service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.023803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-5b860964-7060-440c-8687-c14831256af1 req-4d80075c-674d-42bf-bf58-33707ae2d6eb service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.035061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-5b860964-7060-440c-8687-c14831256af1 req-4d80075c-674d-42bf-bf58-33707ae2d6eb service nova] Creating event network-vif-plugged:8ab37ad3-9454-4510-8c8e-1cbadacef101 for instance f07273ab-250e-4699-a1ba-7f6b264b2d14 on hv-cinder-82880 Sep 13 19:51:02.039910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-5b860964-7060-440c-8687-c14831256af1 req-4d80075c-674d-42bf-bf58-33707ae2d6eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032195 Sep 13 19:51:02.040492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 128/257] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:02.279177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:02.279777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:02.286251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.286727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.287151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.287828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.288267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.288680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.417432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.426139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5bf4a6e5-1d69-4916-be58-16d46a8a766d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.150829 Sep 13 19:51:02.426735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 130/258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:02 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:02.457326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:02.458193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:02.464883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.465378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.465632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1560092133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673951218", "security_groups": [{"name": "tempest-secgroup-smoke-1337610410"}], "block_device_mapping_v2": [{"uuid": "33614e4b-830b-43ef-a8b5-be308b60edf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7494693a-9d87-4054-9604-ca53bc85f841"}]}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:02.465843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.466558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.467005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.467423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.608608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] validate_networks() for [('7494693a-9d87-4054-9604-ca53bc85f841', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:51:02.684747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.693868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.695395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.696588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ca6a78b6-c7cb-4f4f-9f34-58efef1e348e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.244747 Sep 13 19:51:02.697382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 129/259] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:02 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:02.701808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:02.702442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:02.709871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.710353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.710781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.711469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.711910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.712325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.777660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.785164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-58ce20d2-1ae4-4c2c-bb9c-2c66e5c01231 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1292 microversion: 2.1 time: 0.086948 Sep 13 19:51:02.785740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 130/260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:02 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:02.790076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:02.793224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:02.802341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.802929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.803367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.804228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.804861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.805221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.026185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.034365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ad17a398-be20-468a-bd15-690f59582e35 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.247700 Sep 13 19:51:03.035036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 131/261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:02 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:03.039446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.040037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.045733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.046210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.046639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.047312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.048061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.048480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.118446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:51:03.118890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:51:03.119359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:51:03.119760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:51:03.120164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:51:03.129278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.129856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.130288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.131010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.131456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.131870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.149186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Getting quotas for project 1f154705e31748d9b7b8455ee5f73b70. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:51:03.153142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Getting quotas for user 1e09b3554bb64828b857632d1de602d8 and project 1f154705e31748d9b7b8455ee5f73b70. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:51:03.188145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.198134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-98f94415-a6db-4fff-89d6-ce39527a5f38 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.162031 Sep 13 19:51:03.198911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 132/262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:03.219870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:51:03.222001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33614e4b-830b-43ef-a8b5-be308b60edf2',volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:51:03.346936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-04eff1cc-7d0e-47da-92a7-5c14d2265165 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.885072 Sep 13 19:51:03.347570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 131/263] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:51:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 19:51:03.358381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3c1982c8-f547-4436-b3e6-dd09bb39de64 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.358984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3c1982c8-f547-4436-b3e6-dd09bb39de64 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.411409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3c1982c8-f547-4436-b3e6-dd09bb39de64 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.418173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3c1982c8-f547-4436-b3e6-dd09bb39de64 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1094 microversion: 2.1 time: 0.063540 Sep 13 19:51:03.418736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 133/264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:03.450127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.450777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.457471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.457984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.458416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.459106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.459554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.460173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.600549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.609787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bdbe34ef-d2c5-4c36-a567-0f1e3dc82a95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.164142 Sep 13 19:51:03.611060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 132/265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:03.722478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.723275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.730025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.730508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.730985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.731632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.732079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.732497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.809091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.809720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.816169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.816650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.817082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.817797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.818247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.818674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.870787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.878908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.880357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.881601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-92866f54-a125-45d4-be33-3f76844d6730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.163387 Sep 13 19:51:03.882179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 134/266] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:03.886256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:03.893840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b5fb9cce-262c-4509-a3af-f4edc20e94d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1292 microversion: 2.1 time: 0.088959 Sep 13 19:51:03.894396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 133/267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:04.058172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.058785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.065631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.066117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.066547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.067222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.067675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.068095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.195598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.203206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a1237eb7-167f-4bf1-b4f3-e37d54f187ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.148904 Sep 13 19:51:04.203774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 135/268] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:04.224290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.224891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.230774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.231245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.231672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.232348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.232793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.233217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.357980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.365945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b864a543-1671-4c81-992d-b042a9983230 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.145398 Sep 13 19:51:04.366505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 134/269] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:04.440783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.441505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.447397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.447876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.448311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.448988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.449437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.449884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.511229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.518912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ddc047b0-d8a0-43fb-8c09-a6eed0caccab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1144 microversion: 2.1 time: 0.082621 Sep 13 19:51:04.519467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 136/270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:04.632378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.632975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.639220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.639693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.640115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.640782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.641220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.642326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.767550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.775938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8293c8cd-3daa-4b1e-b6e3-138cf8aa76e5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.147454 Sep 13 19:51:04.776494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 135/271] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:04.906330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.906957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.913946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.914418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.914841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.915514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.915953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.916366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.917668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.918273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.924889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.925358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.925817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.926490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.926932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.927345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.006235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.023500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ca77b1f9-b06b-4df9-8c0c-d10fb91f89e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1292 microversion: 2.1 time: 0.109672 Sep 13 19:51:05.024275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 136/272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1292 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:05.070358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.078378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.080327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.081473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e7ae3012-7b50-4a7d-b047-1174c145cb87 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.179142 Sep 13 19:51:05.082056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 137/273] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:05.226597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.227200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:05.233004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.233482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.233956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.234632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.235089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.235507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.362045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.369568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-83895db5-ea7b-43b5-bfc3-1fcd74f7c5a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1510 microversion: 2.1 time: 0.146844 Sep 13 19:51:05.370151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 137/274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:05.388366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.388966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:05.395425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.395921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.396458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.397132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.397569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.398007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.527571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.535209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-854d2dfc-f145-48d1-bbab-cdbc846b32eb tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.150498 Sep 13 19:51:05.535768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 138/275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:05.540176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.540777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:05.546717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.547194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.547914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.548621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.549106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.549497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.609347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.617155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f1748d35-8b34-485a-81ed-5614e9262c94 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1144 microversion: 2.1 time: 0.080762 Sep 13 19:51:05.617753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 138/276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:05.800994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.801721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:05.807733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.808212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.808642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.809325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.809829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.810247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.812927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:05.942401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.950607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4dfa6564-70fa-4197-889b-af36f53026d1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.154476 Sep 13 19:51:05.951176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 139/277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:06.048165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.048853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.059379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.059876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.060302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.063166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.064163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.064593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.108767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.109635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.116445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.117021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.117460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.118184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.118635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.119206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.145113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.154101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-90808420-3086-4a4e-a448-e4ad9b120a8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1292 microversion: 2.1 time: 0.110829 Sep 13 19:51:06.155027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 139/278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:06.301351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.309390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.310863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.312014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a132330-c227-4e36-8fd2-d307c970845a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.208620 Sep 13 19:51:06.312564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 140/279] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:06.395222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.395822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.402076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.402595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.403020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.403749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.404291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.404745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.537480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.545054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5d5ef9da-0935-4efd-a91b-a3dfd336deee tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1516 microversion: 2.1 time: 0.154866 Sep 13 19:51:06.545626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 140/280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:06.558201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.558810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.565471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.566204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.566638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.567324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.567771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.568190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.642385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.643732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.671410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.673299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.674074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.675370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.675958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.676593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.722431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.734667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ee30770c-3279-41c5-82ff-2ac853370c6a tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.180249 Sep 13 19:51:06.736386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 141/281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:06.757495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.769261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eadccae9-bd6c-4bea-90b3-cc6c5905f213 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1136 microversion: 2.1 time: 0.132608 Sep 13 19:51:06.783299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 141/282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1136 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:06.974363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.974966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.978956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:06.982900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.983400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.983852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.984613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.985105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.985529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.119022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.127795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-20dc9c33-0427-404e-8b14-0066e2754be1 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.158462 Sep 13 19:51:07.128352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 142/283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:07.178726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:07.179318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:07.186813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.187588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.188707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.190219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.191665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.192300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.272155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.282755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-52d08b4f-f0fb-4383-95b5-f72a7205b354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1298 microversion: 2.1 time: 0.105361 Sep 13 19:51:07.282755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 142/284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:07 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:07.339384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:07.340163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:07.346607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.347396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.350632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.351391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.353975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.353975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.574947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.583521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.585098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.586299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eadcc5bb-32ba-4a5c-b484-009cc6f5567f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.251161 Sep 13 19:51:07.586839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 143/285] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:07 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:07.762087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:07.763158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:07.772396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.773081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.773746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.774577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.775167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.775780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.796266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:07.800513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:07.801952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:07.809984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.810758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.811389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.812191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.812746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.814452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.939944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.948506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-626ee460-ae7f-4a1c-8cc9-781b8f931187 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1192 microversion: 2.1 time: 0.154410 Sep 13 19:51:07.949487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 144/286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1192 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:07.990868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b3542d62-3175-4c67-b03f-4241eacc8229 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'create', calling method: .version_select at 0x7f676541fb80>, body: {"keypair": {"name": "tempest-keypair-231488979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6QOnbWzhw7lXjUQz1pohVA2xOafn63hEg0M3Yj4LFWsFa0NnwzSFarFbevRu7zyLMiMLFq1NMAWGZqMlmu5PhcHwf00m3ZiCK9lwk3//TBc5xGtnGlrZSPJhAwUDVfow=="}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:08.014662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-b3542d62-3175-4c67-b03f-4241eacc8229 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for project 6991f30f2c094499b73579677b12abae. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:51:08.021164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-b3542d62-3175-4c67-b03f-4241eacc8229 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for user a0e295fda2af4157b196c6130aa2d6d2 and project 6991f30f2c094499b73579677b12abae. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:51:08.046757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b3542d62-3175-4c67-b03f-4241eacc8229 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060487 Sep 13 19:51:08.048282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 145/287] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:51:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:08.152076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:08.152791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:08.159941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.160549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.161439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.162349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.162952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.163799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.454156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.462831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ff68b83f-a465-4813-90d1-7de422f71b06 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1314 microversion: 2.1 time: 0.707294 Sep 13 19:51:08.477435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 143/288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:07 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:08.483847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:08.484667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:08.492330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.493309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.494076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.495055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.495894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.496524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.579917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.588432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a4327e1a-45cc-4316-8fdd-223ed633a20e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.441542 Sep 13 19:51:08.589000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 146/289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:08 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:08.609723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.615568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:08.616181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:08.620420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-69cce21c-a66b-4092-b1ba-960ce094039b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1298 microversion: 2.1 time: 0.141580 Sep 13 19:51:08.621373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 144/290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:08 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:08.634772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.635560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.636660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.637498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.638044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.638469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.899664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.911348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.914560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.915799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6ee935f-fa7c-4a11-9868-d5db8f830d51 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.307457 Sep 13 19:51:08.923266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 147/291] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:08 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:08.979433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:08.980319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:08.990871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.994625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.995069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.995773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.002990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.003623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.117569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.125714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63ceac75-18bb-4edd-bfa7-5ef050541626 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1200 microversion: 2.1 time: 0.154999 Sep 13 19:51:09.126295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 145/292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1200 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:09.492845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:09.493357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:09.502439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.502921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.503353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.504035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.504706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.505127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.612907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:09.613866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:09.620556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.621358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.622028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.622971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.623588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.624094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.825221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.838914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-87b901eb-99df-490f-908e-fd16e53d22f1 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1498 microversion: 2.1 time: 0.350809 Sep 13 19:51:09.840020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 148/293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:09 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:09.854065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:09.854781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:09.863588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.863782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.864203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.864948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.865400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.865900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.976945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.986773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dd66ae64-abc7-4cda-a017-aef7861f08f4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.378417 Sep 13 19:51:10.001996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 146/294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:09 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:10.008381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:10.009196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:10.031659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.033658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.033658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.034460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.035226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.035728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.233843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:10.240318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:10.248357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6aa2786-d4d9-40a9-8096-dbc813bc3918 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.406956 Sep 13 19:51:10.249013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 149/295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:09 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:10.254389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:10.255073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:10.261772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.262334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.262832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.263724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.264180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.264631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.463874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:10.472959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:10.474433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:10.475587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ed0ba2f7-d26c-4d04-ab92-b52cc61a061e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.472669 Sep 13 19:51:10.476140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 147/296] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:10 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:10.601542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:10.609126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f6e62ab7-5240-4c2c-bde4-cdc584bc2e02 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1278 microversion: 2.1 time: 0.359086 Sep 13 19:51:10.609710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 150/297] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:10.816756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-350b21b3-9e39-4a5b-9edd-d81ab79f9209 req-ba96b4b4-d03b-4d4e-9642-5d5e272826fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f29b5c-c5ba-4271-b726-112936bae81a", "tag": "39b82109-ff1d-457f-8efb-e572ab0092bd"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:10.827054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-350b21b3-9e39-4a5b-9edd-d81ab79f9209 req-ba96b4b4-d03b-4d4e-9642-5d5e272826fe service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.827607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-350b21b3-9e39-4a5b-9edd-d81ab79f9209 req-ba96b4b4-d03b-4d4e-9642-5d5e272826fe service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.828094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-350b21b3-9e39-4a5b-9edd-d81ab79f9209 req-ba96b4b4-d03b-4d4e-9642-5d5e272826fe service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.839851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-350b21b3-9e39-4a5b-9edd-d81ab79f9209 req-ba96b4b4-d03b-4d4e-9642-5d5e272826fe service nova] Creating event network-changed:39b82109-ff1d-457f-8efb-e572ab0092bd for instance 85f29b5c-c5ba-4271-b726-112936bae81a on hv-cinder-82880 Sep 13 19:51:10.845569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-350b21b3-9e39-4a5b-9edd-d81ab79f9209 req-ba96b4b4-d03b-4d4e-9642-5d5e272826fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 Sep 13 19:51:10.846187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 148/298] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:11.013578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.014224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.022999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.023534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.023980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.024689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.025175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.025600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.050451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1879301640", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5abbbb93-feb7-43eb-b8b4-aad4144a4459"}], "security_groups": [{"name": "tempest-securitygroup--1598044115"}], "key_name": "tempest-keypair-231488979", "user_data": "}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:11.244743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] validate_networks() for [('5abbbb93-feb7-43eb-b8b4-aad4144a4459', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:51:11.322448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.331178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-15d43641-1ed0-4f1b-b949-c5aae39bfcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.321716 Sep 13 19:51:11.331741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 151/299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:11.336118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.336711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.342372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.342845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.343455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.344131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.345081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.345497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.561642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.569420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f32d4215-55b0-45f5-81cb-e9436bd541da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.236732 Sep 13 19:51:11.570009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 152/300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:11.574429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.574957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.580723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.581200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.581649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.582332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.582774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.583312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.759616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:51:11.760030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:51:11.760495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:51:11.760887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:51:11.761284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:51:11.770325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.771041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.771857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.772590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.773036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.773455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.785351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:11.785818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.792142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for project 6991f30f2c094499b73579677b12abae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:51:11.794297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.795830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.796499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Getting quotas for user a0e295fda2af4157b196c6130aa2d6d2 and project 6991f30f2c094499b73579677b12abae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:51:11.796986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-68a94c2e-41bc-45e3-817d-e11582bb2cfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.226076 Sep 13 19:51:11.798174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 153/301] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:11.802439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.803044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.808683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.809167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.809426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:51:11.809672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.810309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.810761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.811186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.812139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:51:11.863641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-58c7ae8a-33a8-451b-ba62-96085ea976f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.819515 Sep 13 19:51:11.864625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 149/302] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:51:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:51:11.875228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-72d8ca86-6580-49f6-839c-5523c73e3ac8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.875885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-72d8ca86-6580-49f6-839c-5523c73e3ac8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.938777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-72d8ca86-6580-49f6-839c-5523c73e3ac8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.948055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-72d8ca86-6580-49f6-839c-5523c73e3ac8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1245 microversion: 2.1 time: 0.076448 Sep 13 19:51:11.962031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 150/303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:11.973368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.981090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1aa42bf5-456d-4aba-b8a7-9ac44bbbdeed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1278 microversion: 2.1 time: 0.182189 Sep 13 19:51:11.981736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 154/304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:12.356170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:12.356865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:12.363584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.364559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.365184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.366194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.367328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.367924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.590472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:12.591270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:12.598879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.599606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.600358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.601411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.602198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.602843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.642613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:51:12.685870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:12.772460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:12.777748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1bed393a-15d1-45ff-92dd-2ab83cff8d34 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 204 len: 0 microversion: 2.1 time: 0.190793 Sep 13 19:51:12.782015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 155/305] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:51:12 2022] DELETE /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:51:12.784924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ca560516-bbc7-483e-813e-a6c6a6e2a450 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.433872 Sep 13 19:51:12.785591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 151/306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:12 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:12.789082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:12.789916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:12.793447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:12.796004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:12.810055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.811862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.812411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.813570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.814954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.815303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.816159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.816300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.817179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.817564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.818230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.819915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.038971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.042932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.047526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e7709370-e31f-4805-af5a-ed42bd409af8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.262942 Sep 13 19:51:13.048100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 156/307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:12 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:13.052943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.053475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d90999d3-f79d-4466-b284-a21e6d6d6195 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1504 microversion: 2.1 time: 0.264969 Sep 13 19:51:13.066539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.066800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 152/308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:12 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:13.067013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.067120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-a2e59880-136b-4827-9160-ae432fb4d293 req-4b9f15e8-2c05-470f-81db-b2d71a6f875a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbec662-02ef-44f0-9a02-f2b8090a5c1b", "tag": "98859aeb-5541-4304-a25f-f45601b5d33d"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:13.068652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.068652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.068652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.068652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.069016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.073100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a2e59880-136b-4827-9160-ae432fb4d293 req-4b9f15e8-2c05-470f-81db-b2d71a6f875a service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.073100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a2e59880-136b-4827-9160-ae432fb4d293 req-4b9f15e8-2c05-470f-81db-b2d71a6f875a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.073100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a2e59880-136b-4827-9160-ae432fb4d293 req-4b9f15e8-2c05-470f-81db-b2d71a6f875a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.082104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-a2e59880-136b-4827-9160-ae432fb4d293 req-4b9f15e8-2c05-470f-81db-b2d71a6f875a service nova] Creating event network-changed:98859aeb-5541-4304-a25f-f45601b5d33d for instance 0cbec662-02ef-44f0-9a02-f2b8090a5c1b on hv-cinder-82880 Sep 13 19:51:13.086857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-a2e59880-136b-4827-9160-ae432fb4d293 req-4b9f15e8-2c05-470f-81db-b2d71a6f875a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031522 Sep 13 19:51:13.087436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 153/309] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:13.092247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.092926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.099004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.099636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.100071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.100758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.101241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.101684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.180112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.188644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-88754745-802c-40ae-95bc-400ff5cd279c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1297 microversion: 2.1 time: 0.099401 Sep 13 19:51:13.189218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 154/310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:13.194018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.194612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.200576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.201062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.201489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.202205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.202650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.203067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.233705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.245783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.247801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.249060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0a782d7f-204f-42b8-af41-a519d8a5ecd9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.199871 Sep 13 19:51:13.259918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 157/311] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:13.340295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.348818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5265aceb-9e49-4c2b-a62a-47eafc9b0365 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1278 microversion: 2.1 time: 0.158261 Sep 13 19:51:13.349403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 155/312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:13.811933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.812552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.819785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.820265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.820697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.821372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.821862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.822290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.959070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:13.967291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d33ea1fd-b381-4e9c-9fdb-e578290dfb0c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.159211 Sep 13 19:51:13.967849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 158/313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:14.070728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.071327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.078971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.079458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.079895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.080589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.081041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.081323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.081464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.081991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.087984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.088462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.088889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.089565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.090034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.090508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.354916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.362999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e12ac9ec-6e15-4faa-a11d-a2b111be5f7f tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1504 microversion: 2.1 time: 0.286638 Sep 13 19:51:14.363336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.363570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 159/314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:14.369696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.370308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.377010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.377751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.378361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.379209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.379803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.380370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.381592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7eb27a78-0c34-4c93-9d39-73d9ca2bd3fe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.313814 Sep 13 19:51:14.382245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 156/315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:14.388489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.389106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.395964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.396459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.396893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.397583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.398062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.398515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.452309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.462552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3867e237-a6f7-4dc5-bde9-3a3f4cbf4f22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1297 microversion: 2.1 time: 0.097945 Sep 13 19:51:14.474412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:14.484647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.485512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.491932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.492646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.493252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.494124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.494888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.495457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.733161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.742381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.744110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.745527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ed364d40-62a7-4287-af92-ccf92eab2b67 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.361563 Sep 13 19:51:14.746625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 157/317] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:14.816966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.825279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-846ca2c4-c662-43a5-a274-512d8ccf64c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.349797 Sep 13 19:51:14.825865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 161/318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:14.991014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.991538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.997532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.998069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.998502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.999181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.999628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.000043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.280189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:15.288904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7323b9bb-a2ed-402f-bf8e-f196e8ad6fb2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.301756 Sep 13 19:51:15.289471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 158/319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:15.393389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.395343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.418935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.420769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.437667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.438178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.438619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.441062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.441637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.442088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.443673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.444149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.445115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.446247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.446551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.447499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.899648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:15.904544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:15.909579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c4e119bb-5acf-4037-a8c1-921e02891009 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1504 microversion: 2.1 time: 0.520934 Sep 13 19:51:15.910222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 162/320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:15.925761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.926570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.928273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2eed81ef-6c9f-465e-a102-b2b1f276dcbf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.517607 Sep 13 19:51:15.929091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 159/321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:15.934150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.935088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.940947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.941422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.941909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.942586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.943028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.943436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.948639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.949134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.949568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.950290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.954016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.954016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.049131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.063868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2e02f448-ddc1-48af-a172-d1e7ffa4a3fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1303 microversion: 2.1 time: 0.142123 Sep 13 19:51:16.064773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 163/322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:16.071862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:16.072659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:16.080086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.080820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.081247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.082376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.082835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.083262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.155229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.163524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.165124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.166425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ce6ab01-ceaf-438b-b58a-7d8af33f6883 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.236432 Sep 13 19:51:16.167104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 160/323] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:16.180052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-10bea12f-2c53-42f9-8bca-8a3bd0a7ef56 req-a4d7408a-c409-4ade-b968-850ccc15c56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07273ab-250e-4699-a1ba-7f6b264b2d14", "name": "network-vif-deleted", "tag": "8ab37ad3-9454-4510-8c8e-1cbadacef101"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:16.191127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-10bea12f-2c53-42f9-8bca-8a3bd0a7ef56 req-a4d7408a-c409-4ade-b968-850ccc15c56c service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.191689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-10bea12f-2c53-42f9-8bca-8a3bd0a7ef56 req-a4d7408a-c409-4ade-b968-850ccc15c56c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.192187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-10bea12f-2c53-42f9-8bca-8a3bd0a7ef56 req-a4d7408a-c409-4ade-b968-850ccc15c56c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.203760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-10bea12f-2c53-42f9-8bca-8a3bd0a7ef56 req-a4d7408a-c409-4ade-b968-850ccc15c56c service nova] Creating event network-vif-deleted:8ab37ad3-9454-4510-8c8e-1cbadacef101 for instance f07273ab-250e-4699-a1ba-7f6b264b2d14 on hv-cinder-82880 Sep 13 19:51:16.208696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-10bea12f-2c53-42f9-8bca-8a3bd0a7ef56 req-a4d7408a-c409-4ade-b968-850ccc15c56c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040106 Sep 13 19:51:16.209439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 161/324] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:16.252374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.260834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9d62076c-488d-4004-a507-5c13b8c8bde2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.194865 Sep 13 19:51:16.261406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 164/325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:16.314804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:16.315426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:16.322128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.322800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.323245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.323935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.324605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.325294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.461508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.470703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6ef27ebb-4b5c-4813-910d-29feea13ea75 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1725 microversion: 2.1 time: 0.161552 Sep 13 19:51:16.471283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 162/326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:16 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:16.933890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:16.934528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:16.941767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.942246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.942781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.943514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.943958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.944519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.955458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:16.956249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:16.963043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.963650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.964179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.965755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.966454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.967008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.015053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.023878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e4c09223-7847-4b85-9f8e-370ca70e3638 tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1299 microversion: 2.1 time: 0.093930 Sep 13 19:51:17.027301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 165/327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:16 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:17.087068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.087816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:17.094214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.095004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.095675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.096615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.097267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.097922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.145950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.149673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:17.163646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a70a9c05-89cd-4986-8c30-cc03e427b819 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.214407 Sep 13 19:51:17.181800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 163/328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:16 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:17.199474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.200280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:17.210727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.213483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.214199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.215108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.215854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.216485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.342074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.354489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-18c6e043-6fe6-4ab8-b20f-534c2ab46702 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.271082 Sep 13 19:51:17.355868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 166/329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:17.361865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.362734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:17.369889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.370616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.371213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.372274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.372898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.373323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.472597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.481707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.483132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.491080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9263c981-6e28-4585-a77e-3861534bcae5 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.298260 Sep 13 19:51:17.492172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 164/330] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:17.507590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.508195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:17.525082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.525717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.526186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.526971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.527441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.528069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.584709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.592703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6e803540-98e4-4b28-bc1a-eba0ff334a85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.235506 Sep 13 19:51:17.593278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 167/331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:17.690908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.701628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dd57fbab-6538-4f0f-a853-3d680a866238 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1702 microversion: 2.1 time: 0.208209 Sep 13 19:51:17.702333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 165/332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1702 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:17.726383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cf5e8bc9-2819-4266-a026-e5c32d49e198 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:17.733958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5e8bc9-2819-4266-a026-e5c32d49e198 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.735108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5e8bc9-2819-4266-a026-e5c32d49e198 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.735646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5e8bc9-2819-4266-a026-e5c32d49e198 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.806741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cf5e8bc9-2819-4266-a026-e5c32d49e198 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Going to try to start instance {{(pid=127486) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 19:51:17.816262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-18d87844-b339-4f6b-b58f-19780b949136 req-8ffde022-6e50-4459-b4a8-288fd6cd2c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efef25-2b14-468a-9a72-0e6412d56a07", "tag": "c9a1dd24-315a-4d83-b7ac-808bb7dd7e38"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:17.837148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-18d87844-b339-4f6b-b58f-19780b949136 req-8ffde022-6e50-4459-b4a8-288fd6cd2c2e service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.837734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-18d87844-b339-4f6b-b58f-19780b949136 req-8ffde022-6e50-4459-b4a8-288fd6cd2c2e service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.838358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-18d87844-b339-4f6b-b58f-19780b949136 req-8ffde022-6e50-4459-b4a8-288fd6cd2c2e service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.865997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-18d87844-b339-4f6b-b58f-19780b949136 req-8ffde022-6e50-4459-b4a8-288fd6cd2c2e service nova] Creating event network-changed:c9a1dd24-315a-4d83-b7ac-808bb7dd7e38 for instance 10efef25-2b14-468a-9a72-0e6412d56a07 on hv-cinder-82880 Sep 13 19:51:17.876989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-18d87844-b339-4f6b-b58f-19780b949136 req-8ffde022-6e50-4459-b4a8-288fd6cd2c2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064168 Sep 13 19:51:17.878425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 166/333] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:17.878778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cf5e8bc9-2819-4266-a026-e5c32d49e198 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action" status: 202 len: 0 microversion: 2.1 time: 0.156245 Sep 13 19:51:17.882441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 168/334] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:51:17 2022] POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:51:17.890318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.892587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:17.900187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.901028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.901916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.902639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.903347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.904231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.029684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=20 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:18.049015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.049954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.058239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.058727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.059704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.060499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.061064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.061633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.133433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.135630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.142315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.143084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lazy-loading 'fault' on Instance uuid f07273ab-250e-4699-a1ba-7f6b264b2d14 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:51:18.155990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.165837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b93008b2-929a-491e-9179-24d87a750d1a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1711 microversion: 2.1 time: 0.281436 Sep 13 19:51:18.166961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 169/335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1711 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:18.188875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.190324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.196721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.197411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.198041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.198888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.199516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.200090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.219425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7d925b638948649faedc030d14338f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1388306728a45e79823fa7e3156c33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.240124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f8f865d2-a14b-427c-855e-10a7cf2252df tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 200 len: 1304 microversion: 2.1 time: 0.196395 Sep 13 19:51:18.242438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 167/336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:18.383101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.384540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.400089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.400305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.401705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.402562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.404479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.406086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.407131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:18.409013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.424090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-68758c01-b60f-4ffc-b68a-e9a80d647580 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.239041 Sep 13 19:51:18.426132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 170/337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:18.523387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.524004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.532732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.533396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.534043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.534742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.535344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.535925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.575404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.585409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-51780878-abe0-4557-8637-61c00b9f51e3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.208927 Sep 13 19:51:18.588374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 168/338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:18.615510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.615997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.622647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.623458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.624052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.624976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.625430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.626032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.802056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.813394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.816710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.819395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-25c86807-b6a0-4b85-b21a-b903eff279f0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1744 microversion: 2.20 time: 0.300158 Sep 13 19:51:18.820703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 171/339] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1744 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:18.849694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.858075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-99a2c7f9-9487-4b31-b485-104c16af3bc3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.246622 Sep 13 19:51:18.858939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 169/340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:19.189734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.190351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.196691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.197401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.198021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.198713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.199319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.199895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.268721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.269525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] [instance: f07273ab-250e-4699-a1ba-7f6b264b2d14] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.277568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.278421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.279050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.279983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.280491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.281433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.299279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] HTTP exception thrown: Instance f07273ab-250e-4699-a1ba-7f6b264b2d14 could not be found. Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Request method failure captured: Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 HTTP/1.1 Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN8HOOqzgBzmAplpU7RcHiU7m85ypaAGdQo3gaLNxI5Qa0pnBZrBmLMgqAWauMrgwvpcVVycV3IMxrF3P8CtoQyv-0cKCrFJM7uweyTy1FLQGaRcc9-4v1xzqNXdc24mVgZYTyAf2tIzZ0IHs5_kRIOoZbtlE5LwuC6Jc7WGjbPDKvw Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: e1388306728a45e79823fa7e3156c33a Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesActionsTest-1274216456 Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:51:19.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1388306728a45e79823fa7e3156c33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e1388306728a45e79823fa7e3156c33a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e1388306728a45e79823fa7e3156c33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e1388306728a45e79823fa7e3156c33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesActionsTest-1274216456 Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: e1388306728a45e79823fa7e3156c33a Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesActionsTest-1274216456 Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesActionsTest-1274216456-project Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: ef7d925b638948649faedc030d14338f Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesActionsTest-1274216456-project Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance f07273ab-250e-4699-a1ba-7f6b264b2d14 could not be found. Sep 13 19:51:19.302846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'f07273ab-250e-4699-a1ba-7f6b264b2d14'} Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f07273ab-250e-4699-a1ba-7f6b264b2d14 could not be found. Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:19.303732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f07273ab-250e-4699-a1ba-7f6b264b2d14 could not be found. Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f07273ab-250e-4699-a1ba-7f6b264b2d14 could not be found. Sep 13 19:51:19.305111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:51:19.306441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] Returning 404 to user: Instance f07273ab-250e-4699-a1ba-7f6b264b2d14 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:19.306441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fdb9bbf0-1528-410e-8d4c-2adc74c8fb3d tempest-VolumesActionsTest-1274216456 tempest-VolumesActionsTest-1274216456-project] 10.222.0.23 "GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14" status: 404 len: 111 microversion: 2.1 time: 0.038891 Sep 13 19:51:19.306441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 170/341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/f07273ab-250e-4699-a1ba-7f6b264b2d14 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:51:19.370072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:19.383635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e3254aaa-c2b5-47bc-a275-d028779dc7f3 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1711 microversion: 2.1 time: 0.198173 Sep 13 19:51:19.385644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 172/342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1711 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:19.447861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.448470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.454980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.455461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.455969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.456681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.457200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.457667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.613165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:19.618940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.620104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.623860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-72d60d28-29c7-490d-944c-1a8852160ed8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.179210 Sep 13 19:51:19.624278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 171/343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:19.631433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.631914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.632595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.633325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.633818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.634408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.834460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:19.842218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cf069703-4b21-4451-aa9c-610afc7f2a1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.234657 Sep 13 19:51:19.842894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 173/344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:19.863087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.863743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.870101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.870571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.871040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.871824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.872348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.872830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.882673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.883288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.892998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.893479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.893932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.894610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.895049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.895462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.116345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.120814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.127735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.129820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.130614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b3d95907-40d9-486e-bed3-9e940b07d804 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.251657 Sep 13 19:51:20.131105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:20.131768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4502875e-64c8-44be-97ca-35b038b992f4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1744 microversion: 2.20 time: 0.284236 Sep 13 19:51:20.132329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 172/346] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1744 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:20.412830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:20.413578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:20.421247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.422805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.423342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.424022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.424489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.424897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.569549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.578096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-150dc6bd-a60c-4192-bb5d-f54f65dfc13d tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1711 microversion: 2.1 time: 0.169005 Sep 13 19:51:20.578668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 175/347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:20 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:20.647823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:20.648428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:20.654844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.655320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.655750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.656426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.656873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.657296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.787250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.795157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-96f218be-3e2a-4d52-ad5d-8211e94a0f7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.151301 Sep 13 19:51:20.795729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 173/348] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:20 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:20.866135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:20.866891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:20.873044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.873537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.874052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.874757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.875749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.876206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.008320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.017539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-76b078e6-a233-4afe-b18b-8f8fd31471ed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.155499 Sep 13 19:51:21.028100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 176/349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:21.153368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.154274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.157529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.158158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.160503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.161100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.161679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.162446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.163028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.163556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.164126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.164597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.165026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.166220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.166324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.166807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.383480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.387125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.394381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.396637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d15782ea-aae1-4830-a40d-266f45b3ab03 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.247028 Sep 13 19:51:21.397934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 174/350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:21.398135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.399911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fb784753-c5e7-4d25-a87d-47c7f253950b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1744 microversion: 2.20 time: 0.245903 Sep 13 19:51:21.408606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 177/351] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1744 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:21.600376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.601004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.606805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.607277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.607707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.608383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.608822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.609772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.740916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.748968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-021b84df-8f68-4c4e-98e1-d09d358b4c6e tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1711 microversion: 2.1 time: 0.152577 Sep 13 19:51:21.749526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 175/352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:21.819245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.819848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.826343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.826816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.827245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.827921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.828363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.828774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.955259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.962890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-afdbf580-bf84-4c09-967f-c0e2cd24aa4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.147504 Sep 13 19:51:21.963457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 178/353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:22.041568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:22.042204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:22.044163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:22.044911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=14 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:22.051820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.052298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.052743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.053421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.053897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.054313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.191256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:22.205480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9ef2afb8-ac15-4831-8c38-c617f9a3afe0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.168293 Sep 13 19:51:22.206205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 176/354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:22.419840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:22.420626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:22.428359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.429134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:22.429302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.430042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.430323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:22.430902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.431567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.432005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.438104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.440452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.441241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.442059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.442757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.443406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.651225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:22.655050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:22.659862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-15246aa7-8898-4d03-ad5b-b28a18fd68c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.243859 Sep 13 19:51:22.660503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 179/355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:22.665270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:22.666779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:22.668009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bb7fd628-f904-4b27-a3e4-8dba6f10e344 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1744 microversion: 2.20 time: 0.246279 Sep 13 19:51:22.668781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 177/356] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:22 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1744 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:22.699079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-989b50d2-80b1-4f00-a487-04a6459aa13c req-e57bed83-788e-434f-9d81-2f89fafa698b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f29b5c-c5ba-4271-b726-112936bae81a", "name": "network-vif-plugged", "status": "completed", "tag": "39b82109-ff1d-457f-8efb-e572ab0092bd"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:22.709813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-989b50d2-80b1-4f00-a487-04a6459aa13c req-e57bed83-788e-434f-9d81-2f89fafa698b service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.710866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-989b50d2-80b1-4f00-a487-04a6459aa13c req-e57bed83-788e-434f-9d81-2f89fafa698b service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.711307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-989b50d2-80b1-4f00-a487-04a6459aa13c req-e57bed83-788e-434f-9d81-2f89fafa698b service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.723100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-989b50d2-80b1-4f00-a487-04a6459aa13c req-e57bed83-788e-434f-9d81-2f89fafa698b service nova] Creating event network-vif-plugged:39b82109-ff1d-457f-8efb-e572ab0092bd for instance 85f29b5c-c5ba-4271-b726-112936bae81a on hv-cinder-82880 Sep 13 19:51:22.727872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-989b50d2-80b1-4f00-a487-04a6459aa13c req-e57bed83-788e-434f-9d81-2f89fafa698b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Sep 13 19:51:22.728456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 180/357] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:22.772679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:22.773283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:22.779191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.779671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.780106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.780787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.781397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.781705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.986647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:22.987289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:22.994213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.995385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.995922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.996663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.997116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.997544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.207998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.211661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.216186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5feb923a-849c-47ce-be03-4568984ebe41 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1711 microversion: 2.1 time: 0.447344 Sep 13 19:51:23.216756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 178/358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:22 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1711 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:23.219255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1550ca71-6310-40f2-9171-38e643abb183 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.237457 Sep 13 19:51:23.219810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 181/359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:22 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:23.227949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:23.228696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:23.235301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.235774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.236202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.236926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.237311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.237751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.368898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.376570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-72e8ca38-3aeb-430e-85c1-dfb883450d53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.152181 Sep 13 19:51:23.377140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 179/360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:23.683609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:23.684207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:23.690737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.691207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.691634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.692303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.692775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.693186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.694507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:23.695108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:23.701563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.702256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.702696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.704016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.704468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.704921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.892644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.895853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.900571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-47a0e9d0-a35c-41ec-9388-590d6c31be34 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.220827 Sep 13 19:51:23.901222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 182/361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:23.904770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.906246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.907388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4513a388-4abf-4583-8f2b-8628d2ea71ff tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1744 microversion: 2.20 time: 0.217039 Sep 13 19:51:23.907928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 180/362] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:23 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:24.240727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.241290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.241395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.241973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.248022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.248507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.248999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.249469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.250246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.250590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.250707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.251022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.251133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.251699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.252140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.252599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.266467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:24.444927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:24.448846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:24.452613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7c88a0da-40cd-4942-b8f6-f6b50a620d8c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.215019 Sep 13 19:51:24.453775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 181/363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:24.458366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.458939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.460846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-02930cdb-20f9-4def-a451-2378b73576f0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1711 microversion: 2.1 time: 0.224142 Sep 13 19:51:24.461830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 183/364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1711 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:24.467197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.467804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.468347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.469222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.470212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.470850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.625096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:24.635851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ff3b5869-2dcf-47ff-9b22-98fb9c02f4c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.180893 Sep 13 19:51:24.636669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 182/365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:24.923788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.924398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.926520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:24.932167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.932911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.933343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.934348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.934960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.935384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.935927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.937383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.944610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.945343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.945804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.946488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.946929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.947515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.161484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:25.169882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-037b140a-2e06-49b0-8c1d-df5b91b22989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.250515 Sep 13 19:51:25.174406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 184/366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:25.185392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:25.197031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:25.198811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:25.200230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2d839520-6ee3-4c52-81d2-bb7a179ba3aa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.271548 Sep 13 19:51:25.201253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 183/367] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:25.486535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:25.487398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:25.488173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:25.488975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:25.503738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.506012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.507073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.507871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.508497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.509245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.509905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.515043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.515043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.515043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.516134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.516655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.903991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:25.927523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e264d887-453f-4fd6-88cb-d048bd2a3f4e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.449926 Sep 13 19:51:25.931021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 185/368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:25 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:25.946038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:25.947719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:25.966798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.970530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.971182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.972742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.985312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.985964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.057666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.076832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7afe5a75-6bde-468c-91a6-4b32b32e2315 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1715 microversion: 2.1 time: 0.596245 Sep 13 19:51:26.077295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 184/369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:25 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1715 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:26.088863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-f876aa68-6f26-4dfc-954f-f47adac27ff6 req-415ca390-1dc5-41f9-bcf2-bb18e44012cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "name": "network-vif-plugged", "status": "completed", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:26.139533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f876aa68-6f26-4dfc-954f-f47adac27ff6 req-415ca390-1dc5-41f9-bcf2-bb18e44012cd service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.140846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f876aa68-6f26-4dfc-954f-f47adac27ff6 req-415ca390-1dc5-41f9-bcf2-bb18e44012cd service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.142429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f876aa68-6f26-4dfc-954f-f47adac27ff6 req-415ca390-1dc5-41f9-bcf2-bb18e44012cd service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.179512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-f876aa68-6f26-4dfc-954f-f47adac27ff6 req-415ca390-1dc5-41f9-bcf2-bb18e44012cd service nova] Creating event network-vif-plugged:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:51:26.189847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-f876aa68-6f26-4dfc-954f-f47adac27ff6 req-415ca390-1dc5-41f9-bcf2-bb18e44012cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111008 Sep 13 19:51:26.193168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 185/370] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:26.199416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:26.200510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:26.210741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.212090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.212816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.213952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.214547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.215135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.532266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.547261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dac9208a-5d8d-4ad2-bd0a-9b0e765e8e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.347275 Sep 13 19:51:26.548628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 186/371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:26.561891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:26.564853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:26.580270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.581260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.583309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.585703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.586419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.588920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.615015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.637583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d36ff4b8-beae-46d7-be8f-8192e614720b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.702403 Sep 13 19:51:26.640022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 186/372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:26.863657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.876471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.879204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.880914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eacf81fc-4199-4c17-a8fa-1783ae62f202 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.330991 Sep 13 19:51:26.881666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 187/373] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:26 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:26.957813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:26.958618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:26.971423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.971911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.972348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.973052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.973503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.973953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.359433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:27.384163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b445ec7e-4a5b-426e-82e3-7b841d99986c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1366 microversion: 2.1 time: 0.431553 Sep 13 19:51:27.384759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 187/374] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:26 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:27.584636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:27.586201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:27.598363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:27.599202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:27.599784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.603449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:27.604516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:27.605452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.673492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:27.675125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:27.691506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:27.692234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:27.692967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.694102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:27.696116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:27.697525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.712596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:28.062551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:28.086125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7c4ebc89-0d90-4bd9-9eca-6fcab5034332 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.511376 Sep 13 19:51:28.089528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 188/375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:28.097847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:28.098628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:28.102742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:28.108670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.109230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.109690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.110478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.111022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.111452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.116759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f9b8ff00-548f-4dc5-9286-8bfefe41fa1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.456998 Sep 13 19:51:28.121229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 188/376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:28.313389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:28.326612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:28.328640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:28.330156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1498f49b-9a33-4a6b-a6bc-b7c54d1bc012 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.240495 Sep 13 19:51:28.330966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 189/377] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:28 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:28.411116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:28.412856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:28.426153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.426641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.427073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.427801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.428234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.428654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.748941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:28.759045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-147b2860-bb68-4db5-828f-a4de67cf9ba6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1555 microversion: 2.1 time: 0.351886 Sep 13 19:51:28.770825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 189/378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:28 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1555 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:28.794060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:28.795261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:28.803298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.804067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.804707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.805592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.806221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.806817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.939428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-723afd01-8bdc-4e9d-9863-5a7c0cbf27ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149203 Sep 13 19:51:28.950524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 190/379] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:51:28 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:29.128753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:29.129938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:29.157024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:29.157665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:29.165079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:29.165580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:29.166058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:29.166803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:29.167263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:29.167683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:29.183071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:29.192567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:29.199358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:29.202374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:29.208312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:29.218151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:29.535975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:29.565109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cb42da54-adbb-4ec6-838d-0ab47fbfc987 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.417811 Sep 13 19:51:29.578445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 191/380] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:29.600472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:29.601287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:29.624052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:29.651074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:29.651878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:29.665380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:29.666650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:29.667417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:29.668122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:30.003175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:30.026834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9c9deb82-9d96-428c-b84e-2dfe4e06a458 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.920013 Sep 13 19:51:30.031177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 190/381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:30.169834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-3f7a6420-38c5-43ac-9360-6c228644406d req-59c34ef2-2b04-4c80-ac19-d60a93d73163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10efef25-2b14-468a-9a72-0e6412d56a07", "name": "network-vif-plugged", "status": "completed", "tag": "c9a1dd24-315a-4d83-b7ac-808bb7dd7e38"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:30.207357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-3f7a6420-38c5-43ac-9360-6c228644406d req-59c34ef2-2b04-4c80-ac19-d60a93d73163 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:30.213194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-3f7a6420-38c5-43ac-9360-6c228644406d req-59c34ef2-2b04-4c80-ac19-d60a93d73163 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:30.219285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-3f7a6420-38c5-43ac-9360-6c228644406d req-59c34ef2-2b04-4c80-ac19-d60a93d73163 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:30.252358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-3f7a6420-38c5-43ac-9360-6c228644406d req-59c34ef2-2b04-4c80-ac19-d60a93d73163 service nova] Creating event network-vif-plugged:c9a1dd24-315a-4d83-b7ac-808bb7dd7e38 for instance 10efef25-2b14-468a-9a72-0e6412d56a07 on hv-cinder-82880 Sep 13 19:51:30.260412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:30.274819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:30.276669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:30.279038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-3f7a6420-38c5-43ac-9360-6c228644406d req-59c34ef2-2b04-4c80-ac19-d60a93d73163 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113111 Sep 13 19:51:30.281152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1e4e6bf0-8394-4fb8-8107-979d2c45d728 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.700824 Sep 13 19:51:30.282442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 191/382] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:30.298128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 192/383] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:29 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:30.603133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:30.604166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:30.621455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:30.633998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:30.634666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:30.635560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:30.637425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:30.637987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:30.938481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:30.958593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-240ab75a-7a54-4a77-a147-ad8874901e3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.360244 Sep 13 19:51:30.959853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 192/384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:31.069398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:31.070337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:31.083240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.083964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.085204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:31.086295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.100923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.100923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:31.310061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:31.311449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:31.320754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.324660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.326023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:31.329320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.331023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.331724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:31.400847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:31.427350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6580fdc0-c16b-4942-9958-1af3188fc418 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.363663 Sep 13 19:51:31.432212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 193/385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:31.438579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-9c7e6178-3b52-4324-87bb-739d603b257d req-86d90bd0-7fd9-46f9-a9b9-ab183d53e7db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f29b5c-c5ba-4271-b726-112936bae81a", "tag": "39b82109-ff1d-457f-8efb-e572ab0092bd"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:31.450651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-9c7e6178-3b52-4324-87bb-739d603b257d req-86d90bd0-7fd9-46f9-a9b9-ab183d53e7db service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.451522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-9c7e6178-3b52-4324-87bb-739d603b257d req-86d90bd0-7fd9-46f9-a9b9-ab183d53e7db service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.452178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-9c7e6178-3b52-4324-87bb-739d603b257d req-86d90bd0-7fd9-46f9-a9b9-ab183d53e7db service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:31.465294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-9c7e6178-3b52-4324-87bb-739d603b257d req-86d90bd0-7fd9-46f9-a9b9-ab183d53e7db service nova] Creating event network-changed:39b82109-ff1d-457f-8efb-e572ab0092bd for instance 85f29b5c-c5ba-4271-b726-112936bae81a on hv-cinder-82880 Sep 13 19:51:31.471869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-9c7e6178-3b52-4324-87bb-739d603b257d req-86d90bd0-7fd9-46f9-a9b9-ab183d53e7db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037919 Sep 13 19:51:31.477356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 194/386] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:31.698684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:31.709288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:31.711640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:31.713269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-98bbe824-cf45-4911-baf2-999b5a81e360 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.408488 Sep 13 19:51:31.725676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 193/387] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:31 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:31.987090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:31.988549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:32.005129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.010261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.011376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.012578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.013934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.015903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.335851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:32.347397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c7263992-e298-41b5-9ae0-9d76be348267 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.367486 Sep 13 19:51:32.363178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 195/388] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:32.474388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-56045bde-6ccf-4358-85c6-ae0eb85c5ead req-3f9c61cc-71df-4a5f-acbb-a4e3484c5c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbec662-02ef-44f0-9a02-f2b8090a5c1b", "name": "network-vif-plugged", "status": "completed", "tag": "98859aeb-5541-4304-a25f-f45601b5d33d"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:32.475814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:32.476424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:32.503240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.514766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.515964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.519523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-56045bde-6ccf-4358-85c6-ae0eb85c5ead req-3f9c61cc-71df-4a5f-acbb-a4e3484c5c7b service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.520452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-56045bde-6ccf-4358-85c6-ae0eb85c5ead req-3f9c61cc-71df-4a5f-acbb-a4e3484c5c7b service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.521143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-56045bde-6ccf-4358-85c6-ae0eb85c5ead req-3f9c61cc-71df-4a5f-acbb-a4e3484c5c7b service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.527138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.527947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.528468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.583238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-56045bde-6ccf-4358-85c6-ae0eb85c5ead req-3f9c61cc-71df-4a5f-acbb-a4e3484c5c7b service nova] Creating event network-vif-plugged:98859aeb-5541-4304-a25f-f45601b5d33d for instance 0cbec662-02ef-44f0-9a02-f2b8090a5c1b on hv-cinder-82880 Sep 13 19:51:32.604418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-56045bde-6ccf-4358-85c6-ae0eb85c5ead req-3f9c61cc-71df-4a5f-acbb-a4e3484c5c7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137362 Sep 13 19:51:32.606262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 196/389] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:32.743511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:32.744281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:32.758183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.759940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.761655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.764358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:32.765448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:32.767856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.839952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:32.856270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eb476f7a-4ca9-4853-b892-d599e3d44814 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.394091 Sep 13 19:51:32.857225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 194/390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:33.103189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:33.134910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:33.137538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:33.161168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ed5387ad-b49a-4082-97c3-f315ef5d099f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.422442 Sep 13 19:51:33.165886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 197/391] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:32 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:33.373008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:33.373753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:33.397037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:33.397588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:33.398132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:33.398911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:33.399375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:33.399782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:33.755867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:33.764664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-70445884-7b2e-4bb7-b330-c11b15d61e6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.395969 Sep 13 19:51:33.777632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 195/392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:33.895747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:33.896380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:33.909556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:33.910083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:33.910654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:33.911362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:33.911823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:33.912223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:34.191543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:34.192051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:34.207435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:34.207918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:34.208354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:34.211838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:34.213894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:34.214375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:34.214809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:34.221292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-26138039-f69b-4c8c-815f-2bc0f6d0fe3e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.329756 Sep 13 19:51:34.222349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 198/393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:34.509634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:34.523712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:34.525121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:34.526365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-edec108b-415b-46a0-bc5c-c1ddef560717 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.338801 Sep 13 19:51:34.526910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 196/394] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:34 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:34.791217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:34.792134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:34.799045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:34.799801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:34.800416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:34.801286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:34.801919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:34.802505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.008573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:35.039485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2b1ed38b-1815-4324-ac85-6b76dae95877 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1371 microversion: 2.1 time: 0.249535 Sep 13 19:51:35.042940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 199/395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:35.247435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.248677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:35.260340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:35.262833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:35.263575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.267475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:35.268246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:35.268856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.557896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.559558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:35.653536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:35.655817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:35.661685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.664045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:35.667159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:35.668152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.734755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:35.754041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:35.767986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ac3e1ff3-e14e-4788-9ee5-63608ffe8091 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.524907 Sep 13 19:51:35.768485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 197/396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:35.961834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:35.974445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:35.979348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:35.980755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-68b255af-0c8c-479c-af2e-c18bd8f92e5b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.431088 Sep 13 19:51:35.982895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 200/397] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:35 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:36.067078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:36.067693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:36.074090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.074774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.075415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:36.076295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.076904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.077518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:36.306071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:36.321168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0e9a97b1-efc2-48e0-b962-671296e3c794 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1565 microversion: 2.1 time: 0.258588 Sep 13 19:51:36.322909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 198/398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1565 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:36.350417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:36.351340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:36.370030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.370946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.371594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:36.372594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.373386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.374812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:36.511931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-579383b1-596f-4be4-97ea-94ebd26750c1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165265 Sep 13 19:51:36.513161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 201/399] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:51:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:36.803888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:36.804926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:36.815922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.816884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.817819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:36.819129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.820457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.821366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:37.011257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:37.012207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:37.034777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:37.037400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:37.038113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:37.040014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:37.044785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:37.045529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:37.263567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:37.274401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dc260bd0-190b-45b3-9c4e-ebe5187a33c6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1266 microversion: 2.1 time: 0.484001 Sep 13 19:51:37.278785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 199/400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:37.382387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:37.398335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:37.400203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:37.401635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7621cd1e-f2da-4c99-8e53-211ba5c2fbfa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.397019 Sep 13 19:51:37.402742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 202/401] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:37 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:38.306179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:38.307464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:38.318195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.321475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.322107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.327145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.327953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.328581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.432737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:38.434010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:38.450595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.453538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.454221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.455107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.458443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.459834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.719348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:38.735108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ec40807d-8cf0-4587-b25e-a26ca4c5e653 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1453 microversion: 2.1 time: 0.432940 Sep 13 19:51:38.750209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 200/402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1453 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:38.765529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:38.766481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:38.782201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.788716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.789436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.790658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.791261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.791848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.810146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:38.826039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:38.834070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:38.835279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-869efb18-1eb4-421f-a2b6-d877c1cc3c24 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.406699 Sep 13 19:51:38.840222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 203/403] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:38 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:38.961848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-c0386680-15f4-4dc0-b551-254c611f310b req-7813c993-cc8f-4b38-bef9-d0799dd14c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efef25-2b14-468a-9a72-0e6412d56a07", "tag": "c9a1dd24-315a-4d83-b7ac-808bb7dd7e38"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:38.973871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-c0386680-15f4-4dc0-b551-254c611f310b req-7813c993-cc8f-4b38-bef9-d0799dd14c41 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.974885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-c0386680-15f4-4dc0-b551-254c611f310b req-7813c993-cc8f-4b38-bef9-d0799dd14c41 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.975398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-c0386680-15f4-4dc0-b551-254c611f310b req-7813c993-cc8f-4b38-bef9-d0799dd14c41 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.990412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-c0386680-15f4-4dc0-b551-254c611f310b req-7813c993-cc8f-4b38-bef9-d0799dd14c41 service nova] Creating event network-changed:c9a1dd24-315a-4d83-b7ac-808bb7dd7e38 for instance 10efef25-2b14-468a-9a72-0e6412d56a07 on hv-cinder-82880 Sep 13 19:51:39.001503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-c0386680-15f4-4dc0-b551-254c611f310b req-7813c993-cc8f-4b38-bef9-d0799dd14c41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043824 Sep 13 19:51:39.002806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 204/404] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:39.060552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:39.072402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d8b1f1b2-325d-46d4-8004-0e165e4ccd76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1453 microversion: 2.1 time: 0.310798 Sep 13 19:51:39.073005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 201/405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1453 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:39.862631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:39.864803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:39.885766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:39.888608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:39.893753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:39.895024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:39.895714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:39.896313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:40.377962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:40.386892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:40.388352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:40.390134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3a29e80e-b094-445e-a337-b46ff5346dc3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.532921 Sep 13 19:51:40.391016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 205/406] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:39 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:41.419912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:41.420854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:41.429733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:41.430230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:41.430756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:41.431459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:41.432087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:41.432663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:42.105400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:42.117433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:42.119485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:42.124583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-debcc0dc-8d20-4467-a4d7-6ffee822a7bb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1739 microversion: 2.20 time: 0.709321 Sep 13 19:51:42.126670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 202/407] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:41 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1739 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:43.124540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-2c509ed7-a726-4351-893d-0bb5965cf3da req-56ea5042-a48f-44b4-bce0-5ff26dcf67dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cbec662-02ef-44f0-9a02-f2b8090a5c1b", "tag": "98859aeb-5541-4304-a25f-f45601b5d33d"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:43.143643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2c509ed7-a726-4351-893d-0bb5965cf3da req-56ea5042-a48f-44b4-bce0-5ff26dcf67dc service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:43.150950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:43.151565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:43.162247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2c509ed7-a726-4351-893d-0bb5965cf3da req-56ea5042-a48f-44b4-bce0-5ff26dcf67dc service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:43.162695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2c509ed7-a726-4351-893d-0bb5965cf3da req-56ea5042-a48f-44b4-bce0-5ff26dcf67dc service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:43.169367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:43.169877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:43.170311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:43.171823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:43.172269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:43.172679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:43.203710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-2c509ed7-a726-4351-893d-0bb5965cf3da req-56ea5042-a48f-44b4-bce0-5ff26dcf67dc service nova] Creating event network-changed:98859aeb-5541-4304-a25f-f45601b5d33d for instance 0cbec662-02ef-44f0-9a02-f2b8090a5c1b on hv-cinder-82880 Sep 13 19:51:43.228789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-2c509ed7-a726-4351-893d-0bb5965cf3da req-56ea5042-a48f-44b4-bce0-5ff26dcf67dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108185 Sep 13 19:51:43.229862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 206/408] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:43.402061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:43.422113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:43.424162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:43.425543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-918a7215-4f35-46c9-b78b-ff4ff8b616d9 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1721 microversion: 2.20 time: 0.278487 Sep 13 19:51:43.426296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 203/409] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:43 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:44.457687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:44.459089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:44.466354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:44.466616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:44.467748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:44.468604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:44.469210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:44.469907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:44.630636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:44.640236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:44.641760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:44.642991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d5967ffe-86c8-4d13-894f-9452fa2b7f02 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1721 microversion: 2.20 time: 0.190355 Sep 13 19:51:44.643538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 207/410] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:44 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:45.668157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:45.668766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:45.677265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:45.678098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:45.678725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:45.679586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:45.680039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:45.680638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:45.826445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:45.834996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:45.836830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:45.838630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d12383f5-4690-49df-89f3-990bd0348b47 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1721 microversion: 2.20 time: 0.174191 Sep 13 19:51:45.839219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 204/411] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:45 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:46.071709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-90034139-28aa-4f93-ae30-4dd940cfa28f req-88270414-4e44-4dd5-90bf-6e0f1e94dc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "name": "network-vif-unplugged", "status": "completed", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:46.087126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-90034139-28aa-4f93-ae30-4dd940cfa28f req-88270414-4e44-4dd5-90bf-6e0f1e94dc24 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:46.090210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-90034139-28aa-4f93-ae30-4dd940cfa28f req-88270414-4e44-4dd5-90bf-6e0f1e94dc24 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:46.090725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-90034139-28aa-4f93-ae30-4dd940cfa28f req-88270414-4e44-4dd5-90bf-6e0f1e94dc24 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:46.106706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-90034139-28aa-4f93-ae30-4dd940cfa28f req-88270414-4e44-4dd5-90bf-6e0f1e94dc24 service nova] Creating event network-vif-unplugged:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:51:46.115126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-90034139-28aa-4f93-ae30-4dd940cfa28f req-88270414-4e44-4dd5-90bf-6e0f1e94dc24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048217 Sep 13 19:51:46.116647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 208/412] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:46.867806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:46.872092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:46.880255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:46.880774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:46.881218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:46.883963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:46.884459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:46.884907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:46.905872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:47.092866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:47.103375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:47.104889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:47.106329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bec9b644-8bd6-4996-b88f-1300877f3d0f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1724 microversion: 2.20 time: 0.242581 Sep 13 19:51:47.122445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 205/413] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:46 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:47.134920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0cfae5a-27db-49a9-bd51-e5750e8ccd64"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:47.137377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:47.145077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.145591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.146074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.146990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.147664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.148104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.509446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5a3db82f-0f74-4d05-82c3-48350c41662a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378779 Sep 13 19:51:47.510514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 209/414] 10.222.0.23 () {62 vars in 1364 bytes} [Tue Sep 13 19:51:47 2022] POST /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments => generated 188 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:47.667155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:47.667783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:47.674158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.674634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.675249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.675926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.676375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.676787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.723231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127486) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 19:51:47.798756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-863d4f0a-9cdf-46b7-be4d-f82fedf8f5e3 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/action" status: 202 len: 0 microversion: 2.20 time: 0.142915 Sep 13 19:51:47.799361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 206/415] 10.222.0.23 () {62 vars in 1319 bytes} [Tue Sep 13 19:51:47 2022] POST /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 19:51:47.808478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:47.809093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:47.815839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.816613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.817344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.818381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.819032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.819805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.998180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:48.007883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:48.009318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:48.010520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c9dba5bb-30c6-4f11-b886-2be98564c9ce tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1750 microversion: 2.20 time: 0.206069 Sep 13 19:51:48.011297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 210/416] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:47 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:49.038699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:49.039397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:49.045221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:49.045731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:49.046166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:49.047109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:49.047677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:49.047973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:49.189194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:49.199139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:49.200755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:49.202623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c10e2e69-bcb1-4ca0-92fb-a84bc591bdc1 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1750 microversion: 2.20 time: 0.168601 Sep 13 19:51:49.203410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 207/417] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:49 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:50.228250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:50.229443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:50.235406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:50.235890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:50.236328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:50.237020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:50.237535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:50.237957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:50.379364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:50.387999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:50.390043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:50.391192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-00958375-5425-4cd7-bdb1-0717b0fc89ec tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.167285 Sep 13 19:51:50.391733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 211/418] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:50 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:51.418832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:51.419636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:51.427762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:51.428375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:51.428918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:51.429739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:51.430290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:51.430813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:51.684726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:51.718595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:51.720114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:51.721361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-171e38bb-1881-4a02-b32b-c81ed7105c3c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.307941 Sep 13 19:51:51.722518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 208/419] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:51 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:52.752132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.753145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:52.759228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:52.759721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:52.760377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:52.761141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:52.761600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:52.762051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:52.948387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:52.958457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:52.960748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:52.962429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7d476f80-7d9d-4230-9504-9363d4327aa2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.215998 Sep 13 19:51:52.963167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 212/420] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:53.989853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:53.991241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:53.998043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:53.998871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:53.999530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:54.000462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:54.001146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:54.001807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:54.197646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:54.208293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:54.211273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:54.212994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0cb73032-ce06-420e-81cb-28444de979bc tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.226981 Sep 13 19:51:54.213870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 209/421] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:53 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:55.243455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:55.246413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:55.253424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:55.253947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:55.254379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:55.255069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:55.255553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:55.256179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:55.601426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:55.620760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:55.622331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:55.623796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e2350235-2958-4003-81e8-e59ad8e27276 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.384242 Sep 13 19:51:55.624516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 213/422] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:55 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:56.650459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:56.651800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:56.658281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:56.661002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:56.662077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:56.663090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:56.664254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:56.665006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:56.665830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:57.024828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:57.038497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:57.043429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:57.047980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7a134a9d-87a5-4988-8360-1f455240224c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.401458 Sep 13 19:51:57.065984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 210/423] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:56 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:58.088472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:58.089732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:58.102880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:58.103495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:58.103948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:58.104679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:58.105133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:58.105563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:58.627843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:58.638443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:58.640555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:58.642027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f08deaa9-e50d-4dbc-90e9-faa7546f21fa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.558321 Sep 13 19:51:58.642596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 214/424] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:58 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:59.668579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:59.670179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:59.678724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:59.679275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:59.679775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:59.680649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:59.681215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:59.681928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:59.891485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:59.900866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:59.902669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:59.904072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d159ee44-ec23-4b60-a199-8f388c194eaf tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.240034 Sep 13 19:51:59.923949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 211/425] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:59 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:00.933713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:00.936383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:00.939564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=46 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:00.956364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:00.957237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:00.958723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:00.961574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:00.962413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:00.962964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:01.323461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:01.338064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:01.339935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:01.341764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b091267c-468f-422d-af49-6a9bba899a01 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.412755 Sep 13 19:52:01.360407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 215/426] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:00 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:02.376721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:02.378672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:02.390756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:02.391287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:02.391751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:02.392462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:02.392920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:02.393349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:02.655969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:02.667765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:02.679155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:02.680991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bf1f57e1-68ec-4c89-9b7b-db50416db487 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.313438 Sep 13 19:52:02.697723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 212/427] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:02 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:03.728826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:03.730784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:03.740285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:03.741292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:03.742137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:03.743015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:03.744029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:03.744621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:04.096668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:04.104350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:04.115555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:04.117325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:04.123662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f068dc6a-5aa9-4b4d-b041-43a3e51c157b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.402440 Sep 13 19:52:04.124923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 216/428] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:03 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:05.152410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:05.153134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:05.167218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:05.167723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:05.168168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:05.168880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:05.169895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:05.170333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:05.354476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:05.365368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:05.367035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:05.368517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f7c6c444-52e8-4903-ad0c-ca1eaf320600 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.220101 Sep 13 19:52:05.386141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 213/429] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:05 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:05.602974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bf16e094-1e98-4267-b7b8-6e46da99f06d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Action: 'create', calling method: .version_select at 0x7f6765190af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-111336902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZQmSW70h8IVSY+w+OlCX6MuvLIdmiGaXXI/80ohwbaEwWjg+4ce+9Ikq7yeeNJUeVPFB0PxG1P+RlHy1bwE44oVHI60AB6iBqssOz1FqMVqgdIUMBjjfcNIRTgCPRiWA=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:05.627788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-bf16e094-1e98-4267-b7b8-6e46da99f06d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Getting quotas for project df360ab0b7594850b1e0b03b48e1f8ae. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:05.631875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-bf16e094-1e98-4267-b7b8-6e46da99f06d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Getting quotas for user e5a2e785cf504586973630313c0b4607 and project df360ab0b7594850b1e0b03b48e1f8ae. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:05.661400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bf16e094-1e98-4267-b7b8-6e46da99f06d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.296561 Sep 13 19:52:05.662177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 217/430] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:52:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:52:06.396434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:06.397452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:06.405385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:06.406222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:06.407782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:06.409787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:06.410465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:06.411704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:06.622956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:06.631635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:06.633406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:06.634818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-43d17d60-7a8e-4776-bcbf-99146285a644 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.243960 Sep 13 19:52:06.635395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 214/431] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:06 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:07.672259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:07.672941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:07.691356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:07.691848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:07.692280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:07.692981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:07.693422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:07.698758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:07.917087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:07.933438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:07.935362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:07.936732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fea2a327-fd39-43f9-983f-7e048f016da8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.278611 Sep 13 19:52:07.937781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 218/432] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:07 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:08.972712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:08.973323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:08.979600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:08.980075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:08.980502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:08.981184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:08.982241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:08.982668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:09.133751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:09.143773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:09.145437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:09.146824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6b0bacbe-1350-48db-9d56-ace0d2112740 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.178032 Sep 13 19:52:09.147516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 215/433] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:08 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:10.173976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:10.174582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:10.181248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.181788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.182227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.182917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.183396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.183940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.360317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:10.369089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:10.370576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:10.371758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f507c083-13c8-4e38-afa0-0af42a45f6b4 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.201998 Sep 13 19:52:10.372857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 219/434] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:10 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:11.398847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:11.399487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:11.406832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:11.407325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:11.407919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:11.408629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:11.409076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:11.409507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:11.549750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:11.566233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:11.568144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:11.569522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-05ebd2c5-3d5d-459c-9bec-d19734dbc764 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.174819 Sep 13 19:52:11.570567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 216/435] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:11 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:12.596079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:12.596677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:12.603185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:12.603673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:12.604103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:12.604815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:12.605263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:12.605711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:12.744675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:12.754212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:12.755660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:12.756839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1f8eea3e-5b42-44a0-bc75-4a035807a386 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.164721 Sep 13 19:52:12.757404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 220/436] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:12 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:13.594503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-991317747", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "networks": [{"uuid": "cb0fbb12-c072-4b15-b748-9129fbf7d51b"}]}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:13.646254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] validate_networks() for [('cb0fbb12-c072-4b15-b748-9129fbf7d51b', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:52:13.782796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:13.783400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:13.789745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:13.790229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:13.790669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:13.791362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:13.791811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:13.792231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:14.036019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:14.046550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:14.048371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:14.050111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63f720b4-0b7a-48af-8b89-db68110f21e6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.271496 Sep 13 19:52:14.050682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 221/437] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:13 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:14.077300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:52:14.077742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:52:14.078215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:52:14.078615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:52:14.079018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:52:14.087772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:14.088249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:14.088677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:14.089395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:14.089864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:14.090286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:14.107923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Getting quotas for project d030d7bb8d92404e9083b3847fcb0487. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:14.112120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Getting quotas for user 1500cbd765c74fa488e678dda25f5e58 and project d030d7bb8d92404e9083b3847fcb0487. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:14.123917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:52:14.126382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:52:14.183418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4d1687d1-e26a-407e-a0ad-d37b66acbe38 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593096 Sep 13 19:52:14.183986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 217/438] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:52:14.195098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7c914d15-9ef1-4c66-bfcd-00fdd67f1afb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:14.195817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7c914d15-9ef1-4c66-bfcd-00fdd67f1afb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:14.252850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-7114b1b5-8887-47d0-ab6a-edf14be5f194 req-e664dfea-04ba-47c1-8f57-74f6c217da1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "name": "network-vif-plugged", "status": "completed", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:14.269052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-7114b1b5-8887-47d0-ab6a-edf14be5f194 req-e664dfea-04ba-47c1-8f57-74f6c217da1d service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:14.270268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-7114b1b5-8887-47d0-ab6a-edf14be5f194 req-e664dfea-04ba-47c1-8f57-74f6c217da1d service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:14.271084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-7114b1b5-8887-47d0-ab6a-edf14be5f194 req-e664dfea-04ba-47c1-8f57-74f6c217da1d service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:14.272287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7c914d15-9ef1-4c66-bfcd-00fdd67f1afb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:14.283130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-7114b1b5-8887-47d0-ab6a-edf14be5f194 req-e664dfea-04ba-47c1-8f57-74f6c217da1d service nova] Creating event network-vif-plugged:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:52:14.286763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7c914d15-9ef1-4c66-bfcd-00fdd67f1afb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1218 microversion: 2.1 time: 0.095203 Sep 13 19:52:14.301646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 222/439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:14 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:14.302258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-7114b1b5-8887-47d0-ab6a-edf14be5f194 req-e664dfea-04ba-47c1-8f57-74f6c217da1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041181 Sep 13 19:52:14.302258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 218/440] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:15.076058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:15.076584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:15.083619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.084090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.084512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.085186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.085645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.086061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.222410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:15.231327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:15.233441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:15.234739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-887532e8-df45-4476-92c1-ad8d1aef6a18 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.162617 Sep 13 19:52:15.235851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 223/441] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:15 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:15.315652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:15.316460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:15.323255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.323742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.324183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.324892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.325630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.326120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.390288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:15.398279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2a621f58-4aad-4b9a-90ef-9149a1f5623c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1270 microversion: 2.1 time: 0.086748 Sep 13 19:52:15.398967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 219/442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:15 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:16.267212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:16.268032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:16.274779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:16.275256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:16.275689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:16.276381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:16.276824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:16.277245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:16.416015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:16.424696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:16.425350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:16.427227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:16.428903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:16.430167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3756622c-3b87-43da-8652-855ec90a8d60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1808 microversion: 2.20 time: 0.171687 Sep 13 19:52:16.431497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 224/443] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:16 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:16.432223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:16.432954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:16.433659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:16.436508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:16.437306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:16.438245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:16.524402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:16.533043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4a611b54-0198-463b-8bab-7fead9e4599b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1278 microversion: 2.1 time: 0.112428 Sep 13 19:52:16.536251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 220/444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:16 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:17.460961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:17.462242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:17.469973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.470450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.470875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.471571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.472003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.472458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.556410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:17.557359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:17.565250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.565792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.566205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.567153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.567697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.568133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.572862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:17.637001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:17.647216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:17.648694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:17.649883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3d51d32e-e236-4fbf-8e9d-6e4782c637b8 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1795 microversion: 2.20 time: 0.193517 Sep 13 19:52:17.652913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:17.660750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6aa4be3-804e-40e1-8fab-08d41c553cfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1276 microversion: 2.1 time: 0.108273 Sep 13 19:52:17.661897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 221/445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:17 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:17.669333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 225/446] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:17 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1795 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:18.498769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-346e0fd9-1b53-4aee-b13c-dfdc80b89a66 req-120f3f87-35a3-45ae-a715-41036d366bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0987a601-0d82-4c71-bd4d-5874aab1856d", "tag": "351a7533-9ebc-42e3-99e1-6228426cd497"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:18.508309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-346e0fd9-1b53-4aee-b13c-dfdc80b89a66 req-120f3f87-35a3-45ae-a715-41036d366bef service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.508782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-346e0fd9-1b53-4aee-b13c-dfdc80b89a66 req-120f3f87-35a3-45ae-a715-41036d366bef service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.509205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-346e0fd9-1b53-4aee-b13c-dfdc80b89a66 req-120f3f87-35a3-45ae-a715-41036d366bef service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.524737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-346e0fd9-1b53-4aee-b13c-dfdc80b89a66 req-120f3f87-35a3-45ae-a715-41036d366bef service nova] Creating event network-changed:351a7533-9ebc-42e3-99e1-6228426cd497 for instance 0987a601-0d82-4c71-bd4d-5874aab1856d on hv-cinder-82880 Sep 13 19:52:18.529418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-346e0fd9-1b53-4aee-b13c-dfdc80b89a66 req-120f3f87-35a3-45ae-a715-41036d366bef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034997 Sep 13 19:52:18.530050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 222/447] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:18.684023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:18.685218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:18.691220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.691891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.692322 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.692999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.693443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.693882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.828679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:18.836448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-94d8014c-cae8-4853-ab8f-f0d262cd5974 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.156351 Sep 13 19:52:18.837025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 226/448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:18 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:19.861263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:19.862019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:19.868118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:19.868592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:19.869024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:19.869746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:19.870193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:19.870619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:20.005263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:20.013403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d129d783-19a3-490a-9fba-8c6cc7782ccb tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.157429 Sep 13 19:52:20.014002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 223/449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:19 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:21.036436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:21.037036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:21.043966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:21.044441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:21.044864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:21.045794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:21.046246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:21.046659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:21.180038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:21.187928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-33e7414b-87be-49fb-a7e8-63e3eed655b3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.155507 Sep 13 19:52:21.188492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 227/450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:21 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:22.212496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:22.213273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:22.220098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:22.220734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:22.221317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:22.222161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:22.222854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:22.223394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:22.365405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:22.373854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e6840972-1727-438b-b6f8-ed05cc098695 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.165853 Sep 13 19:52:22.378164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 224/451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:22 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:23.397772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:23.398382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:23.405628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:23.406112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:23.406541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:23.407234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:23.407701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:23.408122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:23.535193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:23.543900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-064de4c3-1e2d-4932-b1ef-98f03f744ac4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.149466 Sep 13 19:52:23.544520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 228/452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:23 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:24.360857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-f692f829-0ee8-4ec4-9d2f-96d8ae15bc46 req-6097d2b7-79e1-4323-a490-dd355397a362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0987a601-0d82-4c71-bd4d-5874aab1856d", "name": "network-vif-plugged", "status": "completed", "tag": "351a7533-9ebc-42e3-99e1-6228426cd497"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:24.367479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:24.368148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=6 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:24.373189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f692f829-0ee8-4ec4-9d2f-96d8ae15bc46 req-6097d2b7-79e1-4323-a490-dd355397a362 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.373690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f692f829-0ee8-4ec4-9d2f-96d8ae15bc46 req-6097d2b7-79e1-4323-a490-dd355397a362 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.374121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f692f829-0ee8-4ec4-9d2f-96d8ae15bc46 req-6097d2b7-79e1-4323-a490-dd355397a362 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.385757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-f692f829-0ee8-4ec4-9d2f-96d8ae15bc46 req-6097d2b7-79e1-4323-a490-dd355397a362 service nova] Creating event network-vif-plugged:351a7533-9ebc-42e3-99e1-6228426cd497 for instance 0987a601-0d82-4c71-bd4d-5874aab1856d on hv-cinder-82880 Sep 13 19:52:24.391608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-f692f829-0ee8-4ec4-9d2f-96d8ae15bc46 req-6097d2b7-79e1-4323-a490-dd355397a362 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034771 Sep 13 19:52:24.392465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 225/453] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:24.566830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:24.567435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:24.569284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:24.575218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.575700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.576134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.576819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.577258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.577695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.714869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:24.726354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f4a790b3-c7af-47e7-9b02-f02a95f419dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.163550 Sep 13 19:52:24.726923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 229/454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:24 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:25.750939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:25.751517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:25.757870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.758346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.758776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:25.759475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.759919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.760335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:25.889035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:25.897246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-07479208-53f5-4a18-b08a-a0fa4d590b08 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1318 microversion: 2.1 time: 0.151379 Sep 13 19:52:25.897836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 226/455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:25 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:26.475802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-482663348", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-111336902", "security_groups": [{"name": "tempest-secgroup-smoke-453047211"}], "networks": [{"uuid": "7481f80d-855e-43ee-a026-701c8798b0a8"}], "block_device_mapping_v2": [{"uuid": "2b78c093-83fb-430f-b937-0ab777732f98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:26.593483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] validate_networks() for [('7481f80d-855e-43ee-a026-701c8798b0a8', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:52:26.726080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:26.726633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:26.728748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:26.742628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.743402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.743832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.744605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.745017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.745455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.771577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ec290b3-465a-454c-85a6-4f305bcc8ab7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/ips" status: 200 len: 149 microversion: 2.1 time: 0.049351 Sep 13 19:52:26.772307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 227/456] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:52:26 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:26.784071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87dd2454-6300-43a3-8472-5add0ec790da"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:26.786834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:26.797675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.798238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.798687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.799565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.800025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.800480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.883392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Invalid volume: volume 87dd2454-6300-43a3-8472-5add0ec790da is already attached to instances: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: POST /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/os-volume_attachments HTTP/1.1 Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 74 Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:52:26.885122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {"volumeAttachment": {"volumeId": "87dd2454-6300-43a3-8472-5add0ec790da"}} Sep 13 19:52:26.886739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid volume: volume 87dd2454-6300-43a3-8472-5add0ec790da is already attached to instances: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': '85f29b5c-c5ba-4271-b726-112936bae81a', 'body': {'volumeAttachment': {'volumeId': '87dd2454-6300-43a3-8472-5add0ec790da'}}} Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 87dd2454-6300-43a3-8472-5add0ec790da is already attached to instances: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:26.887612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 87dd2454-6300-43a3-8472-5add0ec790da is already attached to instances: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:26.889083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 87dd2454-6300-43a3-8472-5add0ec790da is already attached to instances: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 400 to user: Invalid volume: volume 87dd2454-6300-43a3-8472-5add0ec790da is already attached to instances: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-79674d10-d93c-46ea-a8d1-2937462edfd3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106803 Sep 13 19:52:26.890536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 228/457] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:52:26 2022] POST /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 19:52:26.896291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:26.896801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:26.903622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.904120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.904561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.905263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.905749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.906179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.933445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:52:26.990281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:52:26.990700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:52:26.991167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:52:26.991674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:52:26.992106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:52:27.001057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.001519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.002212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.002692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.003131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.003716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.021999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Getting quotas for project df360ab0b7594850b1e0b03b48e1f8ae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:27.025149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b8f73fa8-f534-422e-bdcf-63d0136376e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 204 len: 0 microversion: 2.1 time: 0.132718 Sep 13 19:52:27.025770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 229/458] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:52:26 2022] DELETE /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:52:27.026583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Getting quotas for user e5a2e785cf504586973630313c0b4607 and project df360ab0b7594850b1e0b03b48e1f8ae. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:27.031727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:27.032436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:27.038472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.038965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.039401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.040196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.040837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.041360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.086014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:52:27.088187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b78c093-83fb-430f-b937-0ab777732f98',volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:52:27.182406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:27.191553 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-15a62840-e0b8-4868-a1ea-b0c9f71a1939 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1506 microversion: 2.1 time: 0.164630 Sep 13 19:52:27.192243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 230/459] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:27 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:27.217354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:27.218000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:27.221905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-873bd39b-9258-4ff8-8770-64d2ae4c86fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749882 Sep 13 19:52:27.223436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 230/460] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:52:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:52:27.228158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:27.228746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:27.232608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.233107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.233756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.234625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.237665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.237665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.237665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.238099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.238456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.238886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.239089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.239855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.405045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lazy-loading 'services' on Instance uuid 3965b308-7b06-4c6b-8cf6-a14e471c13b9 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:27.416817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:27.427143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fd47fb1f-1551-44f5-8dfe-e24d696fbd8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1680 microversion: 2.1 time: 0.223824 Sep 13 19:52:27.427935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 231/461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:27 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:27.434360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4337c6e3-0760-44ca-85b0-7e54b68b8fa4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:27.435272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4337c6e3-0760-44ca-85b0-7e54b68b8fa4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:27.508309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4337c6e3-0760-44ca-85b0-7e54b68b8fa4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:27.517136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4337c6e3-0760-44ca-85b0-7e54b68b8fa4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1087 microversion: 2.1 time: 0.087106 Sep 13 19:52:27.528212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 232/462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1087 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:27.557790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e9fbfa93-87c2-4fa6-87f7-16f132b83393 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-volume_attachments/112fd7a0-5b11-48f8-b2b6-3cb80b02c930" status: 202 len: 0 microversion: 2.1 time: 0.333424 Sep 13 19:52:27.559041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 231/463] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 19:52:27 2022] DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-volume_attachments/112fd7a0-5b11-48f8-b2b6-3cb80b02c930 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:28.457063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:28.457723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:28.465046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.465516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.465980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.466664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.467118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.467541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.549370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:28.550194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:28.567878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.568492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.568801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.569763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.570210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.570631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.638744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:28.647719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9f802d38-9b1f-456c-a61b-07f6ee95e4d0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1680 microversion: 2.1 time: 0.194510 Sep 13 19:52:28.648498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 233/464] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:28 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:28.660417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:28.668791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-59f8b46f-198e-4efb-85d1-e9172af8c986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1129 microversion: 2.1 time: 0.129573 Sep 13 19:52:28.669724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 232/465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1129 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:29.675939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:29.677391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:29.691096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.691600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.696576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.697912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.698220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.698660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.703841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:29.704779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:29.720032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.723081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.723715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.724692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.725319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.725813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.860152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:29.870124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-be490167-9c80-4e28-a920-8d7f0f7fa8bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1185 microversion: 2.1 time: 0.172926 Sep 13 19:52:29.871182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 233/466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:29.876336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6cb4cf71-8b1c-4da1-bb56-582fe74ae83a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:29.887737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf71-8b1c-4da1-bb56-582fe74ae83a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.888391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf71-8b1c-4da1-bb56-582fe74ae83a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.889520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6cb4cf71-8b1c-4da1-bb56-582fe74ae83a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.912538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:29.913353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6cb4cf71-8b1c-4da1-bb56-582fe74ae83a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Going to try to stop instance {{(pid=127487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 19:52:29.921260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b0df2310-ad29-40dc-a931-24c68cca3a15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1680 microversion: 2.1 time: 0.251580 Sep 13 19:52:29.941934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 234/467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:29 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:29.946735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:29.971362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6cb4cf71-8b1c-4da1-bb56-582fe74ae83a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action" status: 202 len: 0 microversion: 2.1 time: 0.098766 Sep 13 19:52:29.976006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 234/468] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:52:29 2022] POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:29.981988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:29.982777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:29.990212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.990704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.991175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.991875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.992320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.992749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.162845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:30.173738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2c2f1d81-a467-421e-b099-e125e0f47036 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.196222 Sep 13 19:52:30.178174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 235/469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:29 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:30.592522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-a26c7d51-fbc5-4ba7-9c93-236e73f0337b req-4445a23c-0484-4cfa-974c-6c3a49ec1250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f29b5c-c5ba-4271-b726-112936bae81a", "name": "network-vif-deleted", "tag": "39b82109-ff1d-457f-8efb-e572ab0092bd"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:30.612339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a26c7d51-fbc5-4ba7-9c93-236e73f0337b req-4445a23c-0484-4cfa-974c-6c3a49ec1250 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.613200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a26c7d51-fbc5-4ba7-9c93-236e73f0337b req-4445a23c-0484-4cfa-974c-6c3a49ec1250 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.613825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a26c7d51-fbc5-4ba7-9c93-236e73f0337b req-4445a23c-0484-4cfa-974c-6c3a49ec1250 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.635274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-a26c7d51-fbc5-4ba7-9c93-236e73f0337b req-4445a23c-0484-4cfa-974c-6c3a49ec1250 service nova] Creating event network-vif-deleted:39b82109-ff1d-457f-8efb-e572ab0092bd for instance 85f29b5c-c5ba-4271-b726-112936bae81a on hv-cinder-82880 Sep 13 19:52:30.649223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-a26c7d51-fbc5-4ba7-9c93-236e73f0337b req-4445a23c-0484-4cfa-974c-6c3a49ec1250 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061572 Sep 13 19:52:30.650729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 235/470] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:30.897457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:30.898105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:30.904761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.913483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.914360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.916308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.916840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.917423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.950388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:30.951237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:30.968506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:30.973757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.974624 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.975204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.976090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.976885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.977467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.024975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:31.042279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d7b7467b-be79-4cdd-98a1-5a54d51e652e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1203 microversion: 2.1 time: 0.148395 Sep 13 19:52:31.045796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 236/471] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:31.064388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.064883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.086294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.087126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lazy-loading 'fault' on Instance uuid 85f29b5c-c5ba-4271-b726-112936bae81a {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:31.143663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:31.154729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c0e8af68-5e48-452f-aaf2-6f688ffb7501 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 200 len: 1330 microversion: 2.1 time: 0.210319 Sep 13 19:52:31.155872 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 236/472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:30 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 1330 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:31.198075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:31.207630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:31.221767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.226336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.228124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.229222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.231032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.233011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.459735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:31.468401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0738ad8c-539f-48b9-a815-460c731c536a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.274276 Sep 13 19:52:31.468982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 237/473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:31 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:32.071344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:32.071951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:32.079521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.080005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.080619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.082973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.083434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.083858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.190029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:32.191695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:32.198967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.199682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.200283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.201272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.201899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.202645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.221221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a HTTP/1.1 Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:52:32.223833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 19:52:32.225329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '85f29b5c-c5ba-4271-b726-112936bae81a'} Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:52:32.226333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 19:52:32.227720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:32.231581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:52:32.232631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e1b463f-12e9-44b6-b05e-0a68063b7a76 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 404 len: 111 microversion: 2.1 time: 0.055703 Sep 13 19:52:32.236835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:32.237134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 238/474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:32 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:52:32.242998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-727bf107-c6d5-4963-ba3a-adf23e0f4e84 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '.version_select at 0x7f67651cf4c0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:32.244306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f0db3020-5055-4bbb-97d4-b43b70426496 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.177342 Sep 13 19:52:32.267361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 237/475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:32.277456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-727bf107-c6d5-4963-ba3a-adf23e0f4e84 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637734688" status: 202 len: 0 microversion: 2.1 time: 0.038881 Sep 13 19:52:32.279173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 239/476] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 19:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637734688 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:32.495157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:32.496150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:32.506967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.507765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.511383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.512425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.512988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.513489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.891690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:32.906468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ed86389d-8ec1-48eb-a2fc-c5cbde0e8d94 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.415388 Sep 13 19:52:32.916701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 238/477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:32 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:32.934889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-8e21a177-c3ca-497d-881d-6dbdac02a9f9 req-e81d07ad-5a78-4bc2-bbfc-f578869b4370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11000afd-6551-4b16-81dd-f5905971fb0f", "tag": "1fcd70a1-2198-49dc-8b96-511dac023c32"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:32.945592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-8e21a177-c3ca-497d-881d-6dbdac02a9f9 req-e81d07ad-5a78-4bc2-bbfc-f578869b4370 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.946379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-8e21a177-c3ca-497d-881d-6dbdac02a9f9 req-e81d07ad-5a78-4bc2-bbfc-f578869b4370 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.947001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-8e21a177-c3ca-497d-881d-6dbdac02a9f9 req-e81d07ad-5a78-4bc2-bbfc-f578869b4370 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.968567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-8e21a177-c3ca-497d-881d-6dbdac02a9f9 req-e81d07ad-5a78-4bc2-bbfc-f578869b4370 service nova] Creating event network-changed:1fcd70a1-2198-49dc-8b96-511dac023c32 for instance 11000afd-6551-4b16-81dd-f5905971fb0f on hv-cinder-82880 Sep 13 19:52:32.977315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-8e21a177-c3ca-497d-881d-6dbdac02a9f9 req-e81d07ad-5a78-4bc2-bbfc-f578869b4370 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050954 Sep 13 19:52:32.978680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 240/478] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:33.272402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.272951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.279276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.279770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.280209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.280912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.281473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.282014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.317310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.318224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.326406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.326903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.327366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.328369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.328825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.329298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.332309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:33.452489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:33.462011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5d4efb9c-92aa-487e-b35c-f90e485e58bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.192215 Sep 13 19:52:33.462633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 239/479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:33.472304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lazy-loading 'services' on Instance uuid ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:33.587594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c5a1e7fd-7dfa-4e74-b1ea-c4f632f5fd43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments/87dd2454-6300-43a3-8472-5add0ec790da" status: 202 len: 0 microversion: 2.1 time: 0.275609 Sep 13 19:52:33.588224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 241/480] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 19:52:33 2022] DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments/87dd2454-6300-43a3-8472-5add0ec790da => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:52:33.597320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.599603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.606051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.608461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.608908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.609631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.610131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.610519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.643030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ce025d5c-85b7-412e-901e-1cc6968648d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049706 Sep 13 19:52:33.643589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 240/481] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:52:33 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:33.939258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.939957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.946284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.946765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.947199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.947886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.948337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.948761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.080717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:34.088497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a1c52e2c-a95e-411a-a4e0-66ea40a2836b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.153724 Sep 13 19:52:34.089061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 242/482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:33 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:34.485654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.486347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.493277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.493803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.494236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.494926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.495371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.495859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.647463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:34.657120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.658630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3fe40d81-c9c8-43c7-b5da-42168fe9228d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.177134 Sep 13 19:52:34.659559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.659711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 241/483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:34.666211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.666690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.667120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.668416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.668861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.669277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.702801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-643157ca-5b6e-4a13-bfc6-91db974bbcb6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050939 Sep 13 19:52:34.703367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 243/484] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 19:52:34.770205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.770698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.776708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.777731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.778170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.778855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.779306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.779730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.805254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:52:34.882320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6c4b70f7-0570-4417-951d-62a412c27063 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 204 len: 0 microversion: 2.1 time: 0.115700 Sep 13 19:52:34.882907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 242/485] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:52:34 2022] DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:52:34.891807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.892706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.898763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.899246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.899893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.900584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.901039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.901462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.045033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:35.053064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d90f6b17-b43c-4d77-bc54-7c784b650333 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1678 microversion: 2.1 time: 0.165207 Sep 13 19:52:35.053651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 244/486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:35.113054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:35.113832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:35.120072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.120595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.121574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.122354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.122836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.123321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.276479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:35.282576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-11f99d41-0da1-4425-ae9d-a527b57b735f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.174080 Sep 13 19:52:35.283153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 243/487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:35 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:35.689112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:35.689789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:35.696193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.696680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.697112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.697828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.698279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.699266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.833233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:35.840922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-df30e072-816d-4eca-9fa4-cbefd6e40f94 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.155733 Sep 13 19:52:35.841486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 245/488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:36.077726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:36.078340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:36.084760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.085184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.085635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.086319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.086767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.087182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.215256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:36.224496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-99122530-2f03-436c-b159-e97ca1c504ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1678 microversion: 2.1 time: 0.151822 Sep 13 19:52:36.225064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 244/489] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:36 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:36.306095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:36.306698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:36.313242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.313749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.314182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.315023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.315795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.316371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.450180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:36.457849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-defcb9da-e2c2-4704-9719-6005ddddd4d9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.155454 Sep 13 19:52:36.458412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 246/490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:36 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:36.863997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:36.864593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:36.870436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.871425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.871928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.872817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.873266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.873703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.012020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:37.034476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:37.237532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:37.246431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ff41a8a3-9955-427c-834c-f8f6f89b9c02 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.386243 Sep 13 19:52:37.247162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 245/491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:37.248343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:37.248955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:37.255225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.255715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.256150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.256849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.257301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.257771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.403807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:37.413002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e83d36f0-35de-490e-be66-87250248d570 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1678 microversion: 2.1 time: 0.168404 Sep 13 19:52:37.413725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 247/492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:37 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:37.481108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:37.481744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:37.487656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.488128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.488834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.489646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.490165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.490632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.629805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:37.638152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3baa221-aa9e-402c-b157-749802612cf9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.161415 Sep 13 19:52:37.638753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 246/493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:37 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:38.086729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-7da881c7-fd67-4564-93df-e8f0b18adfb1 req-b9412091-6b1c-4d54-8a15-93fc9f49b5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0", "name": "network-vif-deleted", "tag": "002e649f-2cce-4efe-82ec-68136953168c"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:38.101093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:38.108853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-7da881c7-fd67-4564-93df-e8f0b18adfb1 req-b9412091-6b1c-4d54-8a15-93fc9f49b5b2 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.108853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-7da881c7-fd67-4564-93df-e8f0b18adfb1 req-b9412091-6b1c-4d54-8a15-93fc9f49b5b2 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.108853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-7da881c7-fd67-4564-93df-e8f0b18adfb1 req-b9412091-6b1c-4d54-8a15-93fc9f49b5b2 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.123068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-7da881c7-fd67-4564-93df-e8f0b18adfb1 req-b9412091-6b1c-4d54-8a15-93fc9f49b5b2 service nova] Creating event network-vif-deleted:002e649f-2cce-4efe-82ec-68136953168c for instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 on hv-cinder-82880 Sep 13 19:52:38.128650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-7da881c7-fd67-4564-93df-e8f0b18adfb1 req-b9412091-6b1c-4d54-8a15-93fc9f49b5b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045487 Sep 13 19:52:38.129346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 248/494] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:38.272242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.273510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.280283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.281017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.281454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.282217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.282666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.283086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.448126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.450351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.454353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.457479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.458219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.458728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.459524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.460299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.460826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.463364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ee53fdc-8b81-4e05-9bdb-76ab898cc69f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.194940 Sep 13 19:52:38.463937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 247/495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:38.496832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.497313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.497769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.498214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lazy-loading 'fault' on Instance uuid ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:38.561791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.573032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-82bc8842-f54f-43bf-9bef-1eafb2d19fee tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1330 microversion: 2.1 time: 0.137658 Sep 13 19:52:38.577650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 249/496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1330 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:38.660537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.661267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.667385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.668405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.668838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.669524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.669995 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.670666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.807543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.816015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0206a15b-b292-413a-907e-25cbad899df9 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.159208 Sep 13 19:52:38.816703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 248/497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:39.489946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:39.491027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:39.498345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.498829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.499261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.499950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.500391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.500805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.596202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:39.596809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:39.603118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.603600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.604035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.605282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.605695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.606101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.636013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.639926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.640520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.641026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.641539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lazy-loading 'fault' on Instance uuid ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:39.643724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5643f455-bf54-4839-9aa7-a7c74eef44ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.161338 Sep 13 19:52:39.644469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 250/498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:39.644618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:39.686893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.694536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7be831c2-a2d0-4b21-bf5a-4b94504da491 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 200 len: 1330 microversion: 2.1 time: 0.102091 Sep 13 19:52:39.695094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 249/499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:39 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:39.840793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:39.841439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:39.847671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.848155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.848591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.849278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.849761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.850189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.987415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.995081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6e82e22e-ad32-4e1f-ab29-972dfec18417 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.158605 Sep 13 19:52:39.995651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 251/500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:39 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:40.666283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:40.666882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:40.674708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.675196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.675601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.676272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.676713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.677124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.717287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:40.717957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:40.724355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.724836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.725270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.725991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.726444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.726865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.740284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 HTTP/1.1 Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:52:40.742000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 19:52:40.743513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0'} Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:52:40.744264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 19:52:40.746229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:52:40.747379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:52:40.747379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9849d459-1658-433c-a54c-d647ffdc3a9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 404 len: 111 microversion: 2.1 time: 0.030288 Sep 13 19:52:40.748328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 252/501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:40 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:52:40.752501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8f0f4dfe-10e3-4c05-bbf7-5d57359a555e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '.version_select at 0x7f6765287dc0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:40.772205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8f0f4dfe-10e3-4c05-bbf7-5d57359a555e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464261076" status: 202 len: 0 microversion: 2.1 time: 0.023221 Sep 13 19:52:40.772957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 253/502] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 19:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464261076 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:40.814049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:40.824713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-de7a0901-7a9f-418b-aed7-cf232dc2f2e4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.162186 Sep 13 19:52:40.825276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 250/503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:41.018237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:41.019173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:41.025153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.025909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.026554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.027287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.027738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.028171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.243024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:41.250980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e4e8f88e-65f6-4db6-81c1-11ded31c94c6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.236828 Sep 13 19:52:41.251551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 254/504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:41 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:41.482778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-41ed5e78-ab2e-49bd-b5b7-0fa49abaa776 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: .version_select at 0x7f6765190820>, body: {"keypair": {"name": "tempest-keypair-397582461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs5QKE4St4G0PEw1C+rTorDX+6q4Jhbo9w9WFjWmqNgB7xU9AwGPo5kM52i0MsKFbKy6iYI7KXcSfpdyc82F4O0Ctmd9OvBywl+0xEG/hH193DKPxjTAn66ssPjBeSwPQ=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:41.498311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-41ed5e78-ab2e-49bd-b5b7-0fa49abaa776 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:41.502057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-41ed5e78-ab2e-49bd-b5b7-0fa49abaa776 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:41.523563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-41ed5e78-ab2e-49bd-b5b7-0fa49abaa776 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044607 Sep 13 19:52:41.524142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 251/505] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:52:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:41.848398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:41.849630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:41.855882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.856361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.856790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.857717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.858164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.858578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.064826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.072484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-33d3140a-65d9-40ef-a5d1-c3e6c3790fdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.228021 Sep 13 19:52:42.073043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 255/506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:42.274990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:42.275607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:42.281530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.282042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.282462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.283142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.283582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.283997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.484389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-106f925e-d4a3-46b8-9322-6fb0f3ff7ae0 req-f7c052fc-c8ea-4113-845b-84e73e361bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11000afd-6551-4b16-81dd-f5905971fb0f", "name": "network-vif-plugged", "status": "completed", "tag": "1fcd70a1-2198-49dc-8b96-511dac023c32"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:42.496634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-106f925e-d4a3-46b8-9322-6fb0f3ff7ae0 req-f7c052fc-c8ea-4113-845b-84e73e361bb1 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.497110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-106f925e-d4a3-46b8-9322-6fb0f3ff7ae0 req-f7c052fc-c8ea-4113-845b-84e73e361bb1 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.497565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-106f925e-d4a3-46b8-9322-6fb0f3ff7ae0 req-f7c052fc-c8ea-4113-845b-84e73e361bb1 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.502795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.511001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c31c611f-2be8-4a91-90e2-3dc8e0afb19b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.240276 Sep 13 19:52:42.511595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 252/507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:42 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:42.521121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-106f925e-d4a3-46b8-9322-6fb0f3ff7ae0 req-f7c052fc-c8ea-4113-845b-84e73e361bb1 service nova] Creating event network-vif-plugged:1fcd70a1-2198-49dc-8b96-511dac023c32 for instance 11000afd-6551-4b16-81dd-f5905971fb0f on hv-cinder-82880 Sep 13 19:52:42.527065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-106f925e-d4a3-46b8-9322-6fb0f3ff7ae0 req-f7c052fc-c8ea-4113-845b-84e73e361bb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049026 Sep 13 19:52:42.527984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 256/508] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:52:42.950464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1895470299", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35be4e76-9541-4147-ba24-d2a973f5a0c4"}], "security_groups": [{"name": "tempest-securitygroup--1999312362"}], "key_name": "tempest-keypair-397582461", "user_data": "}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:43.051446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] validate_networks() for [('35be4e76-9541-4147-ba24-d2a973f5a0c4', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:52:43.096282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:43.097103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:43.103269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.103822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.104322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.105660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.106177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.106661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.314074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.322098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4813954f-ecb8-403b-af48-50f138d3be92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.230335 Sep 13 19:52:43.322704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 257/509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:43.488326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:52:43.488807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:52:43.489181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:52:43.489651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:52:43.490053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:52:43.498671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.499139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.499546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.500257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.500695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.501107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.517629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:43.521930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:43.533569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:52:43.533757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:43.534273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:43.535787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:52:43.540273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.540759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.541193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.541999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.542959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.543381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.586429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-07ae6a08-d4d5-43ad-90b1-0bd352b45464 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.640101 Sep 13 19:52:43.587334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 253/510] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:52:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:52:43.599050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1bdc5536-79ed-45b2-9cdc-018e3d5a083a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:43.599753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1bdc5536-79ed-45b2-9cdc-018e3d5a083a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:43.681907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1bdc5536-79ed-45b2-9cdc-018e3d5a083a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.689490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1bdc5536-79ed-45b2-9cdc-018e3d5a083a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1241 microversion: 2.1 time: 0.094479 Sep 13 19:52:43.690102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 254/511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:43.718721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.726665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9e1f7ec4-1e2e-4bf3-b3ba-5f249455834f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.196843 Sep 13 19:52:43.727234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 258/512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:43 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:44.346333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:44.346941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:44.353779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.354293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.355376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.356064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.356511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.356929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.487888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:44.497113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-16faa01c-ae8d-409e-8896-36c6d9c29836 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1258 microversion: 2.1 time: 0.154901 Sep 13 19:52:44.497791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 255/513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:44.720317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:44.720858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:44.727381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.727859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.728288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.728969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.729414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.729852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.750423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:44.751694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:44.757846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.758330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.758751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.761266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.761828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.762412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.798993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:44.801355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:44.808168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-83683462-f9eb-439c-a818-be92ea690773 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1293 microversion: 2.1 time: 0.091729 Sep 13 19:52:44.808754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 259/514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:44.897541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:44.906002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bfd2dc4f-2bf3-4172-9e80-070416f80654 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1679 microversion: 2.1 time: 0.160300 Sep 13 19:52:44.906685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 256/515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:44 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:45.487800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1623d753-99ff-44fc-823c-cc29b59f63cb"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:45.490198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:45.496470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.496947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.497377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.498079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.498519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.498934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.522608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:45.523938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:45.531589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.532074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.532603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.533548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.534116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.534660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.676600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:45.684503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-30dcc58c-545e-44fa-bcb4-fbf01eaee3b8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1442 microversion: 2.1 time: 0.167862 Sep 13 19:52:45.685033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 257/516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1442 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:45.706889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:45.707536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:45.713173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.713711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.714191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.715378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.715868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.716361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.860181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:45.872061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c45a9058-7395-4d3a-a15d-bbf9eaaeee6a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1442 microversion: 2.1 time: 0.168922 Sep 13 19:52:45.873055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 258/517] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:45.878146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:45.879051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:45.886466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.887506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.888215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.889135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:45.889670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:45.890502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:45.998930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.012476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1c118df4-b504-4b54-bad9-be17a42f5b17 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1301 microversion: 2.1 time: 0.137800 Sep 13 19:52:46.014798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 259/518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:46.023680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ee7a7c8-bea2-43cd-b0cc-5ddb455d4187", "device": "/dev/sdb"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:46.029883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:46.042352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.042924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.043375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.048799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.049466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.050102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.084009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e673f592-091b-4c75-ae10-9a08d60428b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.600573 Sep 13 19:52:46.090085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 260/519] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:52:45 2022] POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:46.115277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:46.115999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:46.146578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.147210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.147841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.149240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.150981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.152676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.412731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-68e081c8-0548-4e2a-b686-edf126e31f5a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "POST /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396183 Sep 13 19:52:46.413833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 260/520] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:52:46 2022] POST /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:46.436361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.451693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d406e2fe-466d-4b17-b0a9-90f7f7707aab tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1656 microversion: 2.1 time: 0.360247 Sep 13 19:52:46.452610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 261/521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:46 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1656 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:46.476848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5036619f-986b-4158-aed4-308308f2bfc4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:46.496911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5036619f-986b-4158-aed4-308308f2bfc4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.497721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5036619f-986b-4158-aed4-308308f2bfc4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.498158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5036619f-986b-4158-aed4-308308f2bfc4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.523895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5036619f-986b-4158-aed4-308308f2bfc4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Going to try to start instance {{(pid=127487) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 19:52:46.582477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5036619f-986b-4158-aed4-308308f2bfc4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action" status: 202 len: 0 microversion: 2.1 time: 0.110684 Sep 13 19:52:46.583213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 261/522] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:52:46 2022] POST /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:46.593034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:46.593714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:46.600259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.601012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.601718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.602603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.603120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.603573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.807348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.816057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34d2ab1e-60c0-4f5d-a444-f3b23e0ff24a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1665 microversion: 2.1 time: 0.228506 Sep 13 19:52:46.816869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 262/523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:46 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1665 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:47.038915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:47.040276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:47.047729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.048215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.048644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.049332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.049831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.050248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.274505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:47.282506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6eac7cd4-304e-42e4-b497-f40d41debc11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.248116 Sep 13 19:52:47.290056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 262/524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:47 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:47.841832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:47.842957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:47.849986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.850667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.851438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.852291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.852878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.853448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.921332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-faa3a3f7-d0c6-4114-ad99-773f2f4fe9ed req-22502122-8b0c-4f4d-a6bf-f89e0c0d7118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d5be8a-859b-4ba2-a738-a9fa561a778d", "tag": "ccda5d7b-dfeb-449f-ad37-6ddf4890923d"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:47.932875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-faa3a3f7-d0c6-4114-ad99-773f2f4fe9ed req-22502122-8b0c-4f4d-a6bf-f89e0c0d7118 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.933591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-faa3a3f7-d0c6-4114-ad99-773f2f4fe9ed req-22502122-8b0c-4f4d-a6bf-f89e0c0d7118 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.934112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-faa3a3f7-d0c6-4114-ad99-773f2f4fe9ed req-22502122-8b0c-4f4d-a6bf-f89e0c0d7118 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.947177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-faa3a3f7-d0c6-4114-ad99-773f2f4fe9ed req-22502122-8b0c-4f4d-a6bf-f89e0c0d7118 service nova] Creating event network-changed:ccda5d7b-dfeb-449f-ad37-6ddf4890923d for instance c4d5be8a-859b-4ba2-a738-a9fa561a778d on hv-cinder-82880 Sep 13 19:52:47.953249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-faa3a3f7-d0c6-4114-ad99-773f2f4fe9ed req-22502122-8b0c-4f4d-a6bf-f89e0c0d7118 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037624 Sep 13 19:52:47.954195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 263/525] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:48.111965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:48.121098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-16bad662-a749-4a60-a210-bf20304cf01c tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1665 microversion: 2.1 time: 0.283698 Sep 13 19:52:48.122624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 263/526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:47 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1665 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:48.308026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:48.308850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:48.316219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.317104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.317547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:48.318296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.318898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.319321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:48.538049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:48.548770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-abaa480f-0247-4480-b4c6-1b8fbcc6b142 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.245502 Sep 13 19:52:48.549001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 264/527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:48.593133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-0d5f6291-8224-4c07-bbd5-4fcf78c70e14 req-9b505338-3a58-4d3d-9b6e-c932010f80c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11000afd-6551-4b16-81dd-f5905971fb0f", "tag": "1fcd70a1-2198-49dc-8b96-511dac023c32"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:48.608341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-0d5f6291-8224-4c07-bbd5-4fcf78c70e14 req-9b505338-3a58-4d3d-9b6e-c932010f80c2 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.608909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-0d5f6291-8224-4c07-bbd5-4fcf78c70e14 req-9b505338-3a58-4d3d-9b6e-c932010f80c2 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.609520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-0d5f6291-8224-4c07-bbd5-4fcf78c70e14 req-9b505338-3a58-4d3d-9b6e-c932010f80c2 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:48.621862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-0d5f6291-8224-4c07-bbd5-4fcf78c70e14 req-9b505338-3a58-4d3d-9b6e-c932010f80c2 service nova] Creating event network-changed:1fcd70a1-2198-49dc-8b96-511dac023c32 for instance 11000afd-6551-4b16-81dd-f5905971fb0f on hv-cinder-82880 Sep 13 19:52:48.628223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-0d5f6291-8224-4c07-bbd5-4fcf78c70e14 req-9b505338-3a58-4d3d-9b6e-c932010f80c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038624 Sep 13 19:52:48.628818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 264/528] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:49.146672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:49.147941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:49.157494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.158009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.158806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.159511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.159957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.160368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.314666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:49.323809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5056f030-ae5d-446d-aaba-a23a9ec664c7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1669 microversion: 2.1 time: 0.181765 Sep 13 19:52:49.324666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 265/529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:49 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:49.573797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:49.575201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:49.583250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.583963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.584393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.585091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.585534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.585995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.729883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:49.738645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e044aa40-439b-4f40-9e77-f71f4cbee312 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.169692 Sep 13 19:52:49.739369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 265/530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:50.761092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:50.763014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:50.768910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:50.769395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:50.769982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.770673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:50.771153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:50.771574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.908470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:50.916184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c01f6520-806f-4f5e-b5fb-c3c6c310c3d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.159186 Sep 13 19:52:50.916756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 266/531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:51.939732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:51.940335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:51.946833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.947312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.947742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.948419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.949510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.949961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.078680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:52.086265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cc412e4b-5e9f-4aa1-8849-9f08183e05f6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.150539 Sep 13 19:52:52.086913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 266/532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:51 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:52.528943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-6a7ab8ec-a3a6-47aa-82dd-ffa164232ecf req-13d5887d-1db6-4487-a4e4-e1bbc8f81713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5be8a-859b-4ba2-a738-a9fa561a778d", "name": "network-vif-plugged", "status": "completed", "tag": "ccda5d7b-dfeb-449f-ad37-6ddf4890923d"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:52.534614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:52.543400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6a7ab8ec-a3a6-47aa-82dd-ffa164232ecf req-13d5887d-1db6-4487-a4e4-e1bbc8f81713 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.544142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6a7ab8ec-a3a6-47aa-82dd-ffa164232ecf req-13d5887d-1db6-4487-a4e4-e1bbc8f81713 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.544574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6a7ab8ec-a3a6-47aa-82dd-ffa164232ecf req-13d5887d-1db6-4487-a4e4-e1bbc8f81713 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.549401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:52.560548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-6a7ab8ec-a3a6-47aa-82dd-ffa164232ecf req-13d5887d-1db6-4487-a4e4-e1bbc8f81713 service nova] Creating event network-vif-plugged:ccda5d7b-dfeb-449f-ad37-6ddf4890923d for instance c4d5be8a-859b-4ba2-a738-a9fa561a778d on hv-cinder-82880 Sep 13 19:52:52.566454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-6a7ab8ec-a3a6-47aa-82dd-ffa164232ecf req-13d5887d-1db6-4487-a4e4-e1bbc8f81713 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041510 Sep 13 19:52:52.567214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 267/533] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:53.108872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:53.109394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:53.115891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.116371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.116806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.117488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.117961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.118385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.248158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:53.255783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5b4d36c0-95c6-4cc8-bb0f-54cbbafb348b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.150988 Sep 13 19:52:53.256358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 267/534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:53.705400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:53.707605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:53.709500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:53.710754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=12 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:53.719109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.719582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.720004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.720676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.721119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.721535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.744271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'flavor' on Instance uuid 10efef25-2b14-468a-9a72-0e6412d56a07 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:53.863845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-486e5372-e4c9-4b5e-ad62-a6babb5e494c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/action" status: 200 len: 32 microversion: 2.1 time: 0.164051 Sep 13 19:52:53.864475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 268/535] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:52:53 2022] POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:52:53.873964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:53.874574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:53.880574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.881055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.881494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.882208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.882680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.883119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:54.012386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:54.020842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b651c2a2-1fba-45c5-a076-266025784f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.150685 Sep 13 19:52:54.021407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 268/536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:54.279210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:54.279960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:54.286120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:54.286601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:54.287037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:54.287724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:54.288174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:54.288597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:54.424619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:54.432361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-574276c3-0e99-4d9a-86be-0fe687aef789 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1367 microversion: 2.1 time: 0.157396 Sep 13 19:52:54.432940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 269/537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:54 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:55.045440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:55.046232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:55.053072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.053795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.054334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.055234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.055758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.056215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.195371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.204279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-07211924-960e-4986-8ef3-eec69b98c7e1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.163759 Sep 13 19:52:55.204777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 269/538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:55.455937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:55.456455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:55.462870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.463347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.463782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.464457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.464898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.465314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.592982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.600538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c3812b1b-4682-4e68-8275-2eb349161421 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 200 len: 1557 microversion: 2.1 time: 0.148591 Sep 13 19:52:55.601107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 270/539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:55.623425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:55.623910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:55.625876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:55.631053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.631522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.631949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.632652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.633093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.633508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.709950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-97f20996-cd3e-4c82-bcfc-890a1a5c2faf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090792 Sep 13 19:52:55.710539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 270/540] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:52:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:56.227394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:56.228086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:56.234577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.235119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.235551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.236227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.236666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.237080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.467316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:56.475773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6b7d3a4e-9365-47a0-920a-155bf277e397 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.252164 Sep 13 19:52:56.476558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 271/541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:56.727327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-2a3568b2-8c76-47d7-b48e-eccc6b9fff0d req-9f2e8f2e-7962-4710-a80d-0fe560339679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d5be8a-859b-4ba2-a738-a9fa561a778d", "tag": "ccda5d7b-dfeb-449f-ad37-6ddf4890923d"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:56.737010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-2a3568b2-8c76-47d7-b48e-eccc6b9fff0d req-9f2e8f2e-7962-4710-a80d-0fe560339679 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.737489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-2a3568b2-8c76-47d7-b48e-eccc6b9fff0d req-9f2e8f2e-7962-4710-a80d-0fe560339679 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.737944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-2a3568b2-8c76-47d7-b48e-eccc6b9fff0d req-9f2e8f2e-7962-4710-a80d-0fe560339679 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.749545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-2a3568b2-8c76-47d7-b48e-eccc6b9fff0d req-9f2e8f2e-7962-4710-a80d-0fe560339679 service nova] Creating event network-changed:ccda5d7b-dfeb-449f-ad37-6ddf4890923d for instance c4d5be8a-859b-4ba2-a738-a9fa561a778d on hv-cinder-82880 Sep 13 19:52:56.754731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-2a3568b2-8c76-47d7-b48e-eccc6b9fff0d req-9f2e8f2e-7962-4710-a80d-0fe560339679 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031646 Sep 13 19:52:56.755677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 271/542] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:57.500518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:57.501162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:57.507822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.508294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.508719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.509432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.509901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.510315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.643800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:57.652241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-19288657-56fc-4dbe-a07a-aba08d4ea24b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.155653 Sep 13 19:52:57.652813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 272/543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:58.677298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:58.678107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:58.684702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.685171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.685601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.686293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.686736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.687151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.818734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:58.827598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-932cbf36-e94c-4d1f-bf7c-1f45782045ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.154959 Sep 13 19:52:58.828166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 272/544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:59.849951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:59.850530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:59.857746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:59.858300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:59.858802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:59.859487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:59.859944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:59.860364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:59.993519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:00.002418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-97b39de4-3e93-4c87-8122-0982fdf1c6dc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.156563 Sep 13 19:53:00.002991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 273/545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:01.030479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:01.031472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:01.040443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.040919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.041353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.042113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.043071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.043512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.173765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:01.182210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4cc6c093-17c4-4c57-a7ca-90f1bae2eced tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.157233 Sep 13 19:53:01.182823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 273/546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:02.205338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:02.205971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:02.212370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.212851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.213285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.214143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.214596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.215019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.341918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:02.349953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-561821bd-acd4-4a56-9ee1-5b32a3942169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.148419 Sep 13 19:53:02.350559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 274/547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:03.373998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:03.374604 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:03.381013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:03.381502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:03.381968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:03.382660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:03.383132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:03.383557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:03.517082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:03.525271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dc4741e7-ca7b-4bd7-89bb-d434b1102e44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.155682 Sep 13 19:53:03.525865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 274/548] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:04.548927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.549532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:04.556072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:04.556548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:04.556982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:04.557717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:04.558170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:04.558590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:04.689465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:04.697600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ca0b8af-af8e-4f0a-8f19-c8627311e574 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.152450 Sep 13 19:53:04.698185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 275/549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:05.720763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:05.721367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:05.727839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.728316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.728744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.729939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.730383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.730795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.858488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:05.866797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ab1692e-b866-4478-9743-22abc8687fd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.149822 Sep 13 19:53:05.867368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 275/550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:06.891197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:06.891802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:06.898559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.899046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.899476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.900171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.900619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.901037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:07.270656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:07.279803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-abbe193a-f33a-42a2-b51c-ff385fc4c337 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.393173 Sep 13 19:53:07.280379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 276/551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:08.303292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:08.303952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:08.310205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:08.310682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:08.311109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:08.311788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:08.312230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:08.312645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:08.439026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:08.441303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:08.449297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a64016f-aee5-4baf-bea6-f43223796f44 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.149807 Sep 13 19:53:08.450094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 276/552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:09.472210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:09.472840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:09.479181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.479654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.480083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.481303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.481782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.482200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.612744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:09.620828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8f2ce178-3244-4acb-9faf-095ef1d5906f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.152482 Sep 13 19:53:09.622008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 277/553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:10.644807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:10.645390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:10.652643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.653118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.653548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.654250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.654694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.655112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.780398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:10.788398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dea4899d-d8d0-48c3-8192-12cda8e48739 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.147479 Sep 13 19:53:10.788956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 277/554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:11.811630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:11.812238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:11.818641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:11.819124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:11.819563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:11.820242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:11.820690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:11.821112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:11.946645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:11.955316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-df79e0f0-bef8-4312-a129-5ebcc610a9db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.147565 Sep 13 19:53:11.955901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 278/555] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:12.978991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:12.979550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:12.986524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:12.987000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:12.987427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:12.988132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:12.988576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:12.988991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.117518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:13.125626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ff097606-0c3b-4033-b72c-31ed9bf72ab4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.150505 Sep 13 19:53:13.126364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 278/556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:14.149507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:14.150140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:14.156838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.157315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.157776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.158459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.158907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.159328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.293513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:14.302423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e03ebc4f-f8fe-46cd-a43f-384beb5c481e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.156734 Sep 13 19:53:14.302991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 279/557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:15.325879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:15.326426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:15.332806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:15.333287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:15.333808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.334423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:15.334877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:15.335304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.482625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:15.491416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6b76d503-357a-4055-88c0-11071aec8426 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.169485 Sep 13 19:53:15.491977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 279/558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:16.519052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:16.520480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:16.532897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:16.533506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:16.533984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:16.534783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:16.535227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:16.535733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:16.672302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:16.681586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-86700d17-f900-44ca-aaae-2fe88f3bdde3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.170019 Sep 13 19:53:16.682202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 280/559] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:17.581156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:17.581658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:17.587642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.588101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.588531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.589210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.590206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.590626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.673481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 0987a601-0d82-4c71-bd4d-5874aab1856d {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:53:17.707326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:17.707937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:17.714243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.714767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.715202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.715882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.716330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.716750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.744577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-06252935-a68e-4826-930e-c91c657b4261 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d/os-volume_attachments/3ee7a7c8-bea2-43cd-b0cc-5ddb455d4187" status: 202 len: 0 microversion: 2.1 time: 0.167244 Sep 13 19:53:17.745215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 280/560] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 19:53:17 2022] DELETE /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d/os-volume_attachments/3ee7a7c8-bea2-43cd-b0cc-5ddb455d4187 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:53:17.854972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:17.863115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2b788409-9afa-4465-ad7b-9bc8c292fe94 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.159610 Sep 13 19:53:17.863671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 281/561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:18.024014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:18.024613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:18.031348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.031820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.032249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.032917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.033359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.033808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.062407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d5c610f9-89bb-4977-913c-f8af14a615e2 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments/d0cfae5a-27db-49a9-bd51-e5750e8ccd64" status: 200 len: 194 microversion: 2.20 time: 0.042736 Sep 13 19:53:18.062981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 281/562] 10.222.0.23 () {60 vars in 1454 bytes} [Tue Sep 13 19:53:18 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments/d0cfae5a-27db-49a9-bd51-e5750e8ccd64 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:53:18.130765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:18.131252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:18.137084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.137557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.138020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.138758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.139219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.139638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.154339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:18.219801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lazy-loading 'services' on Instance uuid c34b27c6-038e-4f56-80f6-2c4d987b43e4 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:53:18.291524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0400f4bb-572b-4b51-b415-eef826a67cdb tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments/d0cfae5a-27db-49a9-bd51-e5750e8ccd64" status: 202 len: 0 microversion: 2.20 time: 0.164457 Sep 13 19:53:18.292092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 282/563] 10.222.0.23 () {60 vars in 1457 bytes} [Tue Sep 13 19:53:18 2022] DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments/d0cfae5a-27db-49a9-bd51-e5750e8ccd64 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:53:18.301466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:18.303717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:18.309549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.310054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.310619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.311312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.311760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.312180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.340857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-827f2879-d86e-43e0-a58d-f8c39f5e6404 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043337 Sep 13 19:53:18.341425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 282/564] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 13 19:53:18 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:53:18.886952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:18.887715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:18.894638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.895111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.895538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.896205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.896645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.897058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.028923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:19.037323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-98ff2ee0-5fdf-4f34-91a2-cd532dd9a85c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.154845 Sep 13 19:53:19.037939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 283/565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:19.353834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:19.356453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:19.362776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.363264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.363717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.364385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.364834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.365256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.394245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0cc5c450-36d7-4af5-b77e-1e8c22fc7e85 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044422 Sep 13 19:53:19.394795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 283/566] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 13 19:53:19 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:53:20.061618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:20.062243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:20.068584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.069060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.069494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.070191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.070634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.071052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.197346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:20.205491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7b0f3708-6750-4cff-8b39-e18e2fa31271 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.148262 Sep 13 19:53:20.206091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 284/567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:20.407563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:20.409579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:20.415828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.416295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.416720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.417507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.418503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.418919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.447331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cc129af5-dfbe-4b42-89a9-e9658062c343 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043885 Sep 13 19:53:20.447876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 284/568] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 13 19:53:20 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:53:21.228721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.229302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.235763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.236234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.236659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.237331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.237874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.238289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.368720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.377478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7448f9c8-7142-4d51-b0c6-cdef27029b64 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1715 microversion: 2.1 time: 0.152894 Sep 13 19:53:21.378084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 285/569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:21.459897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.462025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.468461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.468939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.469370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.470074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.470518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.470935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.487112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.487533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.493412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.493925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.494363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.495049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.495520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.496137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.501578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-90da56cc-f9e8-4ae9-b81a-559eff61fbaa tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045590 Sep 13 19:53:21.502169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 285/570] 10.222.0.23 () {60 vars in 1343 bytes} [Tue Sep 13 19:53:21 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:21.567365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.567938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.574520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.575007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.575441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.576382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.576838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.577258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.579164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Cannot 'detach_volume' instance 10efef25-2b14-468a-9a72-0e6412d56a07 while it is in vm_state rescued Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments/1623d753-99ff-44fc-823c-cc29b59f63cb HTTP/1.1 Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:53:21.580779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:53:21.582400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Cannot 'detach_volume' instance 10efef25-2b14-468a-9a72-0e6412d56a07 while it is in vm_state rescued Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '10efef25-2b14-468a-9a72-0e6412d56a07', 'id': '1623d753-99ff-44fc-823c-cc29b59f63cb'} Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:53:21.583205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 10efef25-2b14-468a-9a72-0e6412d56a07 while it is in vm_state rescued Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 10efef25-2b14-468a-9a72-0e6412d56a07 while it is in vm_state rescued Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:21.584736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 409 to user: Cannot 'detach_volume' instance 10efef25-2b14-468a-9a72-0e6412d56a07 while it is in vm_state rescued {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:53:21.586068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c3883a89-3a44-4627-b4cb-b321ff5801dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments/1623d753-99ff-44fc-823c-cc29b59f63cb" status: 409 len: 152 microversion: 2.1 time: 0.099774 Sep 13 19:53:21.586068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 286/571] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 19:53:21 2022] DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments/1623d753-99ff-44fc-823c-cc29b59f63cb => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 19:53:21.591076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:21.591636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.598339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.598823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.599260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.599945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.600392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.600812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.608528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:53:21.667281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-09b83d35-9320-406d-ae1e-cc50cd8ad0ac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/action" status: 202 len: 0 microversion: 2.1 time: 0.079100 Sep 13 19:53:21.672024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 287/572] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:53:21 2022] POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:53:21.678168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.679226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.688507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.689557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.690043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.691480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.691951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.692723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.694144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1a30f7f6-20fe-4a2b-9d16-8f521e638685 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 204 len: 0 microversion: 2.20 time: 0.131225 Sep 13 19:53:21.699063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 286/573] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 13 19:53:21 2022] DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 19:53:21.703962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.704768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.712503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.713082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.713641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.714801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.715267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.715805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.902871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.906058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.911924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3dd93c5a-25ce-4d0e-8953-e0d813b35c0d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1723 microversion: 2.1 time: 0.238551 Sep 13 19:53:21.912588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 288/574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:21.914111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.915543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.916677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bcb3899e-06fa-4a9b-b6f3-79ab57a0307d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.217387 Sep 13 19:53:21.917219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 287/575] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:21 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:22.935562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:22.936155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:22.942150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:22.942620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:22.942760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:22.943095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:22.943519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:22.944202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:22.944646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:22.945059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:22.949132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:22.949811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:22.950299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:22.951617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:22.952065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:22.952485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:23.139857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:23.143580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:23.148387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-50b64e7e-bcdb-474e-87c2-2fb0038e8fb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1723 microversion: 2.1 time: 0.216666 Sep 13 19:53:23.149216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 289/576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:23.151604 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:23.153044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:23.154303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b72b84b5-1fa6-47a8-9658-d7298108d334 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.216328 Sep 13 19:53:23.154843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 288/577] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:22 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:24.172960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:24.186570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:24.188295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:24.189314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=46 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:24.189453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:24.197461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.197940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.198430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.198861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.199285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.199551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.199732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.199997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.200413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.200723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.201186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.201626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.398511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.407944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-58b4803f-2200-4ef0-87c6-032751754ab2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1723 microversion: 2.1 time: 0.240175 Sep 13 19:53:24.421644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 290/578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:24.421999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.422120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:24.422120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:24.422269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.422376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.422376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.422376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.422596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.422691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.422968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.423110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ce500004-3bcc-47d2-8d36-9aa350ce4a3f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1723 microversion: 2.20 time: 0.238716 Sep 13 19:53:24.423388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.429688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 289/579] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:24 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:24.448295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:53:24.530640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-52cac0c0-a64e-44d6-9eb3-5a6ec28e53a3 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 204 len: 0 microversion: 2.1 time: 0.119820 Sep 13 19:53:24.531513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 291/580] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:53:24 2022] DELETE /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:53:24.539562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:24.540173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:24.546897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.547398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.547838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.548548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.548999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.549423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.700360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.708663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bf4f8ada-0ea4-4f87-914f-d11443639ea4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1512 microversion: 2.1 time: 0.172934 Sep 13 19:53:24.709226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 290/581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:24 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:25.163533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-6c84536b-1132-47a8-a808-b1a1b436bb93 req-f75aad20-fbd8-45fc-9a65-dab784ca0f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34b27c6-038e-4f56-80f6-2c4d987b43e4", "name": "network-vif-deleted", "tag": "0957a077-700f-4f47-b2d1-ad015cdb3bd5"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:25.173542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6c84536b-1132-47a8-a808-b1a1b436bb93 req-f75aad20-fbd8-45fc-9a65-dab784ca0f6a service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.174176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6c84536b-1132-47a8-a808-b1a1b436bb93 req-f75aad20-fbd8-45fc-9a65-dab784ca0f6a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.174505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6c84536b-1132-47a8-a808-b1a1b436bb93 req-f75aad20-fbd8-45fc-9a65-dab784ca0f6a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.185396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-6c84536b-1132-47a8-a808-b1a1b436bb93 req-f75aad20-fbd8-45fc-9a65-dab784ca0f6a service nova] Creating event network-vif-deleted:0957a077-700f-4f47-b2d1-ad015cdb3bd5 for instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 on hv-cinder-82880 Sep 13 19:53:25.191751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-6c84536b-1132-47a8-a808-b1a1b436bb93 req-f75aad20-fbd8-45fc-9a65-dab784ca0f6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032363 Sep 13 19:53:25.192466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 292/582] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:25.434744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:25.436708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:25.444082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.444647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.445155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.445972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.446579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.447072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.448978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:25.449850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:25.450302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:25.457308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.457839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.458281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.458980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.459433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.459857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.545141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.553006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.554475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.555626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dbe48519-3d12-4d95-b9de-cd57d0cbdc60 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1655 microversion: 2.20 time: 0.110998 Sep 13 19:53:25.556503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 293/583] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:25 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:25.612689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.620842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fda708e2-ed8b-4549-80a1-da25e067dfd3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1723 microversion: 2.1 time: 0.190026 Sep 13 19:53:25.621412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 291/584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:25.734965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:25.735568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:25.741412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.741931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.742364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.743038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.743487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.743904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.874851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.882703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-14b7610d-fff2-45e4-9e8c-11e988b53d7b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1512 microversion: 2.1 time: 0.152238 Sep 13 19:53:25.883267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 294/585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:25 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:26.582150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:26.582807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:26.585109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:26.591165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.592257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.592688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.593365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.593849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.594263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.644480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:26.645078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:26.651523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.652001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.652429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.653275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.653539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.654555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.656276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.664282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.665732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.666856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2abdcda5-c83d-4c34-82d8-05c9bd717da0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1655 microversion: 2.20 time: 0.088634 Sep 13 19:53:26.667409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 292/586] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:26 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:26.785580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.793732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f1bd1984-6cf6-43b7-8aac-68d0da832270 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1723 microversion: 2.1 time: 0.153059 Sep 13 19:53:26.795038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 295/587] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:26.905532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:26.906198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:26.911997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.912469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.912896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.913563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.914030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.914445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.041093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.049540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c27afd3f-8d4f-4cf4-a094-6863ad13f287 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1512 microversion: 2.1 time: 0.147797 Sep 13 19:53:27.050119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 293/588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:26 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:27.692373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:27.693003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:27.699393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:27.699871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:27.700301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.701555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:27.702028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:27.702452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.717248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:27.765593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.775204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.776731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.778998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-054729dc-3b96-4f98-a338-e922801081de tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1366 microversion: 2.20 time: 0.090101 Sep 13 19:53:27.779691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 296/589] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:27 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:27.817684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:27.818347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:27.824822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:27.825297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:27.825825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.826977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:27.827429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:27.827852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.960193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.968804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e498d8ef-9cff-43d1-82dc-6b01ae3b371e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1723 microversion: 2.1 time: 0.155054 Sep 13 19:53:27.969366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 294/590] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:28.072573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:28.073183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:28.079914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.083014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.083014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:28.083014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.083014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.083382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:28.215144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:28.222718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5ccac30d-36b4-4a15-b386-cdfd11a6bc74 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1512 microversion: 2.1 time: 0.154156 Sep 13 19:53:28.223306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 297/591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:28 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:28.804632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:28.805244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:28.811442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.811930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.813141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:28.813999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.814461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.814892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:28.847688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.848266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.848551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:28.848989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lazy-loading 'fault' on Instance uuid c34b27c6-038e-4f56-80f6-2c4d987b43e4 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:53:28.893648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:28.901903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:28.903347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:28.905066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-533a8ec9-827d-4c4e-9315-3210d492871b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 200 len: 1371 microversion: 2.20 time: 0.104718 Sep 13 19:53:28.905643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 295/592] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:28 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:28.992585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:28.993189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:28.999894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.000376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.000811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.001496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.001978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.002394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.020459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-4596fb57-af5d-40c6-befe-91c24acf04db req-0b64a97b-2b69-470e-958d-43ebab21ef01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0987a601-0d82-4c71-bd4d-5874aab1856d", "name": "network-vif-deleted", "tag": "351a7533-9ebc-42e3-99e1-6228426cd497"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:29.030893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-4596fb57-af5d-40c6-befe-91c24acf04db req-0b64a97b-2b69-470e-958d-43ebab21ef01 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.031460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-4596fb57-af5d-40c6-befe-91c24acf04db req-0b64a97b-2b69-470e-958d-43ebab21ef01 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.031887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-4596fb57-af5d-40c6-befe-91c24acf04db req-0b64a97b-2b69-470e-958d-43ebab21ef01 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.045240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-4596fb57-af5d-40c6-befe-91c24acf04db req-0b64a97b-2b69-470e-958d-43ebab21ef01 service nova] Creating event network-vif-deleted:351a7533-9ebc-42e3-99e1-6228426cd497 for instance 0987a601-0d82-4c71-bd4d-5874aab1856d on hv-cinder-82880 Sep 13 19:53:29.050256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-4596fb57-af5d-40c6-befe-91c24acf04db req-0b64a97b-2b69-470e-958d-43ebab21ef01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034379 Sep 13 19:53:29.050860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 296/593] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:29.132507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:29.141249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bfd621ae-82c3-47fa-954b-481090e05a1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1729 microversion: 2.1 time: 0.152444 Sep 13 19:53:29.141832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 298/594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:29.166557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:29.167135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:29.174424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.174908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.175344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.176032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.176481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.176909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.248081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:29.248651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:29.262287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.262788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.263974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.264693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.265141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.265595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.273138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fef896bd-9b80-47cb-a423-d50f350f4766 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110754 Sep 13 19:53:29.281599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 297/595] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:53:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:29.370899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:29.383730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-40592a9c-b332-4ee1-972a-c992a4c01ead tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 200 len: 1303 microversion: 2.1 time: 0.141769 Sep 13 19:53:29.384728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 299/596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:29 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:29.930506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:29.931173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:29.943734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.944265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.944730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.945471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:29.945904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:29.946330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.965442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 HTTP/1.1 Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 19:53:29.967705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 19:53:29.969091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'c34b27c6-038e-4f56-80f6-2c4d987b43e4'} Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:53:29.970323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 19:53:29.971647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 19:53:29.974741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:53:29.974741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ca40a8cb-788a-43ae-8de3-af387f4c13b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 404 len: 111 microversion: 2.20 time: 0.043209 Sep 13 19:53:29.978497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f87699f4-23c2-44c3-84d5-a3024387629c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '.version_select at 0x7f676519a430>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:29.984019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 298/597] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:29 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:53:29.999656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f87699f4-23c2-44c3-84d5-a3024387629c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459135222" status: 204 len: 0 microversion: 2.20 time: 0.025217 Sep 13 19:53:30.012283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 300/598] 10.222.0.23 () {60 vars in 1259 bytes} [Tue Sep 13 19:53:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459135222 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 19:53:30.215626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-9ca10a97-a2e2-4042-92ad-a8b30569fd45 req-902666aa-7b12-40bd-aafb-6e89536123be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efef25-2b14-468a-9a72-0e6412d56a07", "tag": "c9a1dd24-315a-4d83-b7ac-808bb7dd7e38"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:30.228547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-9ca10a97-a2e2-4042-92ad-a8b30569fd45 req-902666aa-7b12-40bd-aafb-6e89536123be service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:30.229581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-9ca10a97-a2e2-4042-92ad-a8b30569fd45 req-902666aa-7b12-40bd-aafb-6e89536123be service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:30.230188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-9ca10a97-a2e2-4042-92ad-a8b30569fd45 req-902666aa-7b12-40bd-aafb-6e89536123be service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:30.246104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-9ca10a97-a2e2-4042-92ad-a8b30569fd45 req-902666aa-7b12-40bd-aafb-6e89536123be service nova] Creating event network-changed:c9a1dd24-315a-4d83-b7ac-808bb7dd7e38 for instance 10efef25-2b14-468a-9a72-0e6412d56a07 on hv-cinder-82880 Sep 13 19:53:30.251361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-9ca10a97-a2e2-4042-92ad-a8b30569fd45 req-902666aa-7b12-40bd-aafb-6e89536123be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040316 Sep 13 19:53:30.252564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 299/599] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:30.409054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:30.409959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 0987a601-0d82-4c71-bd4d-5874aab1856d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:30.417104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:30.417587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:30.418221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:30.419374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:30.419826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:30.420250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:30.433908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Instance 0987a601-0d82-4c71-bd4d-5874aab1856d could not be found. Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d HTTP/1.1 Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:53:30.435881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 0987a601-0d82-4c71-bd4d-5874aab1856d could not be found. Sep 13 19:53:30.437226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '0987a601-0d82-4c71-bd4d-5874aab1856d'} Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0987a601-0d82-4c71-bd4d-5874aab1856d could not be found. Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:53:30.437999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0987a601-0d82-4c71-bd4d-5874aab1856d could not be found. Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0987a601-0d82-4c71-bd4d-5874aab1856d could not be found. Sep 13 19:53:30.439208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:30.440312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 404 to user: Instance 0987a601-0d82-4c71-bd4d-5874aab1856d could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:53:30.440312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f4cb645a-59f5-4b21-8e60-9a163ecbd485 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d" status: 404 len: 111 microversion: 2.1 time: 0.032556 Sep 13 19:53:30.440312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 301/600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:30 2022] GET /compute/v2.1/servers/0987a601-0d82-4c71-bd4d-5874aab1856d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:53:30.873708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-06ace73f-9a71-4dc6-9bb2-ef8cfddcdf76 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'create', calling method: .version_select at 0x7f6765178e50>, body: {"keypair": {"name": "tempest-keypair-1371436922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAQkFrFePNwDHWjUv4SQ71NfxthURangqSlFOWyVmRmGv/2e5vXxF9r303Xk7E+vPsZmijOhD3DlPEiSJ3sn3yZtn/UlXqHw6qkVp8/A5jpKMR1PX75+UE6mBcPnyO3Kg=="}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:30.891552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-06ace73f-9a71-4dc6-9bb2-ef8cfddcdf76 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:30.895939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-06ace73f-9a71-4dc6-9bb2-ef8cfddcdf76 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for user 3177776f47ef4d3e937c2e8efb360e79 and project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'key_pairs'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:30.920436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-06ace73f-9a71-4dc6-9bb2-ef8cfddcdf76 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050745 Sep 13 19:53:30.921201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 300/601] 10.222.0.23 () {62 vars in 1200 bytes} [Tue Sep 13 19:53:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 19:53:32.190619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-406896193", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8baa0457-21f1-4851-9755-1397ee066193"}], "security_groups": [{"name": "tempest-securitygroup--1378789998"}], "key_name": "tempest-keypair-1371436922", "user_data": "}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:32.270579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-8b3ea4ea-830a-45af-a06b-bdd0e25d51c5 req-d2f348b2-ef20-42a0-a5d8-e73101a834f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efef25-2b14-468a-9a72-0e6412d56a07", "tag": "c9a1dd24-315a-4d83-b7ac-808bb7dd7e38"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:32.280867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-8b3ea4ea-830a-45af-a06b-bdd0e25d51c5 req-d2f348b2-ef20-42a0-a5d8-e73101a834f6 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:32.281453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-8b3ea4ea-830a-45af-a06b-bdd0e25d51c5 req-d2f348b2-ef20-42a0-a5d8-e73101a834f6 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:32.281915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-8b3ea4ea-830a-45af-a06b-bdd0e25d51c5 req-d2f348b2-ef20-42a0-a5d8-e73101a834f6 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:32.292583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-8b3ea4ea-830a-45af-a06b-bdd0e25d51c5 req-d2f348b2-ef20-42a0-a5d8-e73101a834f6 service nova] Creating event network-changed:c9a1dd24-315a-4d83-b7ac-808bb7dd7e38 for instance 10efef25-2b14-468a-9a72-0e6412d56a07 on hv-cinder-82880 Sep 13 19:53:32.296296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] validate_networks() for [('8baa0457-21f1-4851-9755-1397ee066193', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:53:32.298636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-8b3ea4ea-830a-45af-a06b-bdd0e25d51c5 req-d2f348b2-ef20-42a0-a5d8-e73101a834f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Sep 13 19:53:32.299217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 301/602] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:53:32.665419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:53:32.665862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:53:32.666331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:53:32.666726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:53:32.667135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:53:32.676483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:32.676972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:32.677390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:32.678142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:32.678589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:32.679009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:32.707908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:32.712050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Getting quotas for user 3177776f47ef4d3e937c2e8efb360e79 and project f03c01ff6ef24c59b65362c66ad1a1ea. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:32.723581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:53:32.725898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:53:32.773015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-87793a94-2054-4a11-b131-1ffe650ab4ab tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.586601 Sep 13 19:53:32.773665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 302/603] 10.222.0.23 () {62 vars in 1188 bytes} [Tue Sep 13 19:53:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 19:53:32.785934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5b975619-7367-455a-94f0-c94a9cd3c83f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:32.786638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5b975619-7367-455a-94f0-c94a9cd3c83f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:32.843523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5b975619-7367-455a-94f0-c94a9cd3c83f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:32.850815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5b975619-7367-455a-94f0-c94a9cd3c83f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:32.852238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5b975619-7367-455a-94f0-c94a9cd3c83f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:32.853324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5b975619-7367-455a-94f0-c94a9cd3c83f tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1281 microversion: 2.20 time: 0.071615 Sep 13 19:53:32.853904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 302/604] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:32 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:33.879125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:33.879737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:33.886658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:33.887426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:33.888214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:33.889126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:33.889917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:33.890639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:33.962186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:33.972071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:33.973526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:33.974861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-968c4317-2bbb-4ddd-88db-b4f1514b0b5d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1333 microversion: 2.20 time: 0.100403 Sep 13 19:53:33.979474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 303/605] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:33 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:35.000570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:35.001184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:35.015595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:35.015595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:35.015595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:35.015595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:35.016010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:35.016010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:35.083635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:35.092739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:35.094473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:35.096367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c605ba66-ad84-4242-be7f-b75354fb430a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1339 microversion: 2.20 time: 0.100035 Sep 13 19:53:35.110167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 303/606] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:34 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:35.805053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-0bd257a4-9c67-4cb0-b6e8-9969bb77800a req-915ffd33-f6c4-4c4b-a32a-04bbbc58de2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0d01e4-a3dc-4f0e-91fe-19875dca7be4", "tag": "5f4800b1-c512-43ec-81b8-f2fd3dc5bd44"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:35.815840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-0bd257a4-9c67-4cb0-b6e8-9969bb77800a req-915ffd33-f6c4-4c4b-a32a-04bbbc58de2a service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:35.816326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-0bd257a4-9c67-4cb0-b6e8-9969bb77800a req-915ffd33-f6c4-4c4b-a32a-04bbbc58de2a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:35.816750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-0bd257a4-9c67-4cb0-b6e8-9969bb77800a req-915ffd33-f6c4-4c4b-a32a-04bbbc58de2a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:35.827519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-0bd257a4-9c67-4cb0-b6e8-9969bb77800a req-915ffd33-f6c4-4c4b-a32a-04bbbc58de2a service nova] Creating event network-changed:5f4800b1-c512-43ec-81b8-f2fd3dc5bd44 for instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 on hv-cinder-82880 Sep 13 19:53:35.832582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-0bd257a4-9c67-4cb0-b6e8-9969bb77800a req-915ffd33-f6c4-4c4b-a32a-04bbbc58de2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031118 Sep 13 19:53:35.833174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 304/607] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:53:36.121341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:36.122012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:36.128442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:36.128927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:36.129362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:36.130068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:36.130518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:36.130941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:36.259680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:36.267711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:36.269126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:36.270225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-32c882f9-2ddf-4ccb-a51d-538f6c36277b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.152792 Sep 13 19:53:36.270778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 304/608] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:36 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:37.296854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:37.297462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:37.303544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:37.304000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:37.304424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:37.305122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:37.305564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:37.306006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:37.434797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:37.443103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:37.444536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:37.445649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b74f78b9-04ee-4afe-9e56-c28276870f56 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.154329 Sep 13 19:53:37.446206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 305/609] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:37 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:38.340342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-740032205", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "networks": [{"uuid": "cb0fbb12-c072-4b15-b748-9129fbf7d51b"}]}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:38.394509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] validate_networks() for [('cb0fbb12-c072-4b15-b748-9129fbf7d51b', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:53:38.470500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:38.471139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:38.477523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:38.478037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:38.478466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:38.479152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:38.479598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:38.480015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:38.953699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:38.961861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:38.963283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:38.964384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c7603ac1-fe6a-4eeb-9601-4d695be20c0e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.497879 Sep 13 19:53:38.964934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 306/610] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:38 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:39.054130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:53:39.054552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:53:39.055046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:53:39.055438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:53:39.055846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:53:39.064545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:39.065026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:39.065518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:39.066274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:39.066728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:39.067155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:39.084491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Getting quotas for project d030d7bb8d92404e9083b3847fcb0487. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:39.088474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Getting quotas for user 1500cbd765c74fa488e678dda25f5e58 and project d030d7bb8d92404e9083b3847fcb0487. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:39.100315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:53:39.102673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:53:39.147245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-183e0aff-7296-4fdd-a106-e84fd30c995b tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810573 Sep 13 19:53:39.147946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 305/611] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:53:39.159168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2823c729-275a-48ba-8f4c-e3e17a842b6d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:39.159767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2823c729-275a-48ba-8f4c-e3e17a842b6d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:39.217877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2823c729-275a-48ba-8f4c-e3e17a842b6d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:39.226058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2823c729-275a-48ba-8f4c-e3e17a842b6d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1218 microversion: 2.1 time: 0.070606 Sep 13 19:53:39.226633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 307/612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:39 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:39.990303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:39.990930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:39.998684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:39.999169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:39.999603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:40.000292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:40.000817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:40.001186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:40.135422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.143872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.145328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.146464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-52c6c1a5-88cf-45bb-a457-ed51d6540814 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.160571 Sep 13 19:53:40.147017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 306/613] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:39 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:40.248785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:40.249328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:40.255687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:40.256166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:40.256600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:40.257282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:40.257760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:40.258182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:40.320976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.328951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-67781cec-e003-4ad2-8a51-75ac1ae768dc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1270 microversion: 2.1 time: 0.084646 Sep 13 19:53:40.329524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 308/614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:40 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:41.171367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:41.172020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:41.178903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:41.179405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:41.179841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:41.180544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:41.180995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:41.181417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:41.322040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:41.330604 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:41.332060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:41.333181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bdd0290a-663e-48c5-91cd-8a4e188090cd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.166638 Sep 13 19:53:41.333787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 307/615] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:41 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:41.351821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:41.352463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:41.359301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:41.359783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:41.360221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:41.360903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:41.361354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:41.361807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:41.423882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:41.432214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b7d5f497-1edb-4ef8-b42b-f158e72fcf13 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1276 microversion: 2.1 time: 0.084131 Sep 13 19:53:41.433018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 309/616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:41 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:42.358961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:42.359585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:42.366184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:42.366662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:42.367103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:42.367766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:42.368205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:42.368619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:42.456543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:42.458189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:42.465474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:42.465972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:42.466812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:42.467507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:42.467964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:42.468538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:42.513739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.522392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.524271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.525540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e44c4cfb-cde3-4214-b4fa-6d8108af4e73 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.171032 Sep 13 19:53:42.526226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 308/617] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:42 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:42.531009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-e7c4a8bf-2aa2-42d7-9030-4511e3f2edae req-caed1bab-4e37-4ad2-8b95-464970b40769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9614bd92-6967-41b4-9bf0-d8206beda6dc", "tag": "c6bfa8b1-3373-4b8f-9840-c7faa918bb8a"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:42.541147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-e7c4a8bf-2aa2-42d7-9030-4511e3f2edae req-caed1bab-4e37-4ad2-8b95-464970b40769 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:42.541990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-e7c4a8bf-2aa2-42d7-9030-4511e3f2edae req-caed1bab-4e37-4ad2-8b95-464970b40769 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:42.542854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-e7c4a8bf-2aa2-42d7-9030-4511e3f2edae req-caed1bab-4e37-4ad2-8b95-464970b40769 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:42.556121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-e7c4a8bf-2aa2-42d7-9030-4511e3f2edae req-caed1bab-4e37-4ad2-8b95-464970b40769 service nova] Creating event network-changed:c6bfa8b1-3373-4b8f-9840-c7faa918bb8a for instance 9614bd92-6967-41b4-9bf0-d8206beda6dc on hv-cinder-82880 Sep 13 19:53:42.562797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-e7c4a8bf-2aa2-42d7-9030-4511e3f2edae req-caed1bab-4e37-4ad2-8b95-464970b40769 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Sep 13 19:53:42.563669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 309/618] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:42.618919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.627360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e5ab5576-6e24-47dd-86da-e9547fb4d8bc tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.175640 Sep 13 19:53:42.627934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 310/619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:42 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:43.552938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:43.553687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:43.559825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.560303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.560736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.561424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.562021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.562446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.650211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:43.650958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:43.653156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:43.661010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.661721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.661978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.662681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.666202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.666202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.702057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.710656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.712220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.713412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4e30066e-bbbe-42da-9177-7caf9530d090 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.167010 Sep 13 19:53:43.725546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 310/620] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:43 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:43.731104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-13bd5e51-e530-48f8-94f3-0b7d71c6535c req-f204cfa9-377e-4aaa-a0d5-62d3b1fea282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0d01e4-a3dc-4f0e-91fe-19875dca7be4", "name": "network-vif-plugged", "status": "completed", "tag": "5f4800b1-c512-43ec-81b8-f2fd3dc5bd44"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:43.741201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-13bd5e51-e530-48f8-94f3-0b7d71c6535c req-f204cfa9-377e-4aaa-a0d5-62d3b1fea282 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.741741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-13bd5e51-e530-48f8-94f3-0b7d71c6535c req-f204cfa9-377e-4aaa-a0d5-62d3b1fea282 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.742175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-13bd5e51-e530-48f8-94f3-0b7d71c6535c req-f204cfa9-377e-4aaa-a0d5-62d3b1fea282 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.753710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-13bd5e51-e530-48f8-94f3-0b7d71c6535c req-f204cfa9-377e-4aaa-a0d5-62d3b1fea282 service nova] Creating event network-vif-plugged:5f4800b1-c512-43ec-81b8-f2fd3dc5bd44 for instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 on hv-cinder-82880 Sep 13 19:53:43.758692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-13bd5e51-e530-48f8-94f3-0b7d71c6535c req-f204cfa9-377e-4aaa-a0d5-62d3b1fea282 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Sep 13 19:53:43.759438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 311/621] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:43.814738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.822479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7d101b6b-6c2d-46a0-8ed1-fbf6b4c6580e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.176200 Sep 13 19:53:43.823045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 311/622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:43 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:44.740625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:44.741339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:44.747572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.748749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.749190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.749897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.750345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.750764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.844321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:44.844907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:44.851582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.852065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.852917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.853274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.853742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.854498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.883211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.891943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.893381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.894511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2a315c08-8b8a-444d-bf90-f72434a49a79 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1407 microversion: 2.20 time: 0.158620 Sep 13 19:53:44.895066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 312/623] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:44 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:44.982575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.990597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3f6237c-7acf-48b3-85e2-b5c14597ecfe tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.150222 Sep 13 19:53:44.991169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 312/624] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:44 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:45.923310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:45.923897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:45.930428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.930902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.931345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.932018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.932463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.932884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.012174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:46.012892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:46.020367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.021091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.021786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.022221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.022690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.023104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.075503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.083954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.085732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.086963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-79df7eed-60e4-472f-8fa6-cf113c4a4730 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1598 microversion: 2.20 time: 0.167611 Sep 13 19:53:46.087594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 313/625] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:45 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:46.112612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:46.113107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:46.119011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.119501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.119938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.120630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.121077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.121715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.138803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:46.177786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.186221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-97b3dced-ae08-4564-9b50-2131c8a4f23d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.177230 Sep 13 19:53:46.188044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 313/626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:46 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:46.213391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3b22c7cd-def4-4625-aa32-6214b830bc70 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104861 Sep 13 19:53:46.214014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 314/627] 10.222.0.23 () {60 vars in 1316 bytes} [Tue Sep 13 19:53:46 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:53:47.132972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-a7796d3d-42ce-4334-89a5-269e1558cc6c req-badcc167-ab3c-4112-83c8-1030a6c55331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0d01e4-a3dc-4f0e-91fe-19875dca7be4", "tag": "5f4800b1-c512-43ec-81b8-f2fd3dc5bd44"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:47.144453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a7796d3d-42ce-4334-89a5-269e1558cc6c req-badcc167-ab3c-4112-83c8-1030a6c55331 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.144817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a7796d3d-42ce-4334-89a5-269e1558cc6c req-badcc167-ab3c-4112-83c8-1030a6c55331 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.145236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a7796d3d-42ce-4334-89a5-269e1558cc6c req-badcc167-ab3c-4112-83c8-1030a6c55331 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.157760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-a7796d3d-42ce-4334-89a5-269e1558cc6c req-badcc167-ab3c-4112-83c8-1030a6c55331 service nova] Creating event network-changed:5f4800b1-c512-43ec-81b8-f2fd3dc5bd44 for instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 on hv-cinder-82880 Sep 13 19:53:47.163142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-a7796d3d-42ce-4334-89a5-269e1558cc6c req-badcc167-ab3c-4112-83c8-1030a6c55331 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033651 Sep 13 19:53:47.164204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 314/628] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:47.208794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:47.209577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:47.215923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.216518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.217056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.217901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.218451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.218974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.370036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:47.378908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f83ce862-48e8-42f0-9bf1-4d861fff7549 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.174393 Sep 13 19:53:47.380219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 315/629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:47 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:47.741268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-5152ae42-3cb6-4168-9c15-ddc6aba715a7 req-76b39c14-5f03-451c-81b1-0161496e78e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9614bd92-6967-41b4-9bf0-d8206beda6dc", "name": "network-vif-plugged", "status": "completed", "tag": "c6bfa8b1-3373-4b8f-9840-c7faa918bb8a"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:47.757167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-5152ae42-3cb6-4168-9c15-ddc6aba715a7 req-76b39c14-5f03-451c-81b1-0161496e78e7 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.757964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-5152ae42-3cb6-4168-9c15-ddc6aba715a7 req-76b39c14-5f03-451c-81b1-0161496e78e7 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.758562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-5152ae42-3cb6-4168-9c15-ddc6aba715a7 req-76b39c14-5f03-451c-81b1-0161496e78e7 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.773875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-5152ae42-3cb6-4168-9c15-ddc6aba715a7 req-76b39c14-5f03-451c-81b1-0161496e78e7 service nova] Creating event network-vif-plugged:c6bfa8b1-3373-4b8f-9840-c7faa918bb8a for instance 9614bd92-6967-41b4-9bf0-d8206beda6dc on hv-cinder-82880 Sep 13 19:53:47.780061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-5152ae42-3cb6-4168-9c15-ddc6aba715a7 req-76b39c14-5f03-451c-81b1-0161496e78e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045624 Sep 13 19:53:47.780834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 315/630] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:47.915502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:47.917689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:47.924356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.924856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.925291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.926073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.926518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.926934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.962320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7ade351d-c9fb-40e5-91c3-79545b162136 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050757 Sep 13 19:53:47.963073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 316/631] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:53:47 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:53:48.036071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:48.036650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:48.042958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.043709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.044142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.044863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.045310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.045769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.072252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:53:48.123968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:48.152322 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3ad14cef-5eab-4c34-becf-1126c8fbc6eb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 204 len: 0 microversion: 2.1 time: 0.120203 Sep 13 19:53:48.153033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 316/632] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:53:48 2022] DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:53:48.162213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:48.162819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:48.172672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.173155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.173835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.174523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.174970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.175386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.320097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:48.327895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9521ed23-fc0c-4078-9041-82e35463c8a7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1675 microversion: 2.1 time: 0.170226 Sep 13 19:53:48.328394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 317/633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:48 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:48.403699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:48.404384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:48.410657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.411146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.411584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.412302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.412784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.413209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.544190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:48.552241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-30d4a97e-844b-4ae5-bbbd-020ca6621e0c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.152738 Sep 13 19:53:48.552805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 317/634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:48 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:49.350904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:49.351508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:49.353335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.354024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=12 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.360754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.361231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.361691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.362389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.362841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.363259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.489739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:49.497403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f52a3aea-8499-45ac-8772-ea1c1c8bc190 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1675 microversion: 2.1 time: 0.150414 Sep 13 19:53:49.498870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 318/635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:49 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:49.576617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:49.577164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:49.579163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=8 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.584718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.585190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.585633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.586308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.586751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.587166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.718185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:49.725738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-54c5d84f-bd02-4216-a5b6-687bf8674f8a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.154368 Sep 13 19:53:49.726300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 318/636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:49 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:50.522357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:50.522939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:50.529322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.529829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.530264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.530939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.531385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.531806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.664692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:50.673176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8de4b30f-0fc1-4d47-96b8-d2ff865c09b2 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1675 microversion: 2.1 time: 0.154747 Sep 13 19:53:50.673765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 319/637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:50 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:50.748787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:50.749386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:50.756061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.756548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.756987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.757706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.758157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.758652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.885803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:50.893385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-45ba3367-dc68-460c-afa9-2d36503d1d4c tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1318 microversion: 2.1 time: 0.149019 Sep 13 19:53:50.893981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 319/638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:50 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:51.697637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:51.697637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:51.705862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.706554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.707159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.708078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.708891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.709011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.757090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-c665742e-7484-4da7-983d-1c23272c1536 req-94adfb46-52e3-48ad-92c7-af7751300ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3965b308-7b06-4c6b-8cf6-a14e471c13b9", "name": "network-vif-deleted", "tag": "7ef6f233-e8a9-46ca-913a-804b61bdeb70"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:51.770731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-c665742e-7484-4da7-983d-1c23272c1536 req-94adfb46-52e3-48ad-92c7-af7751300ab5 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.771626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-c665742e-7484-4da7-983d-1c23272c1536 req-94adfb46-52e3-48ad-92c7-af7751300ab5 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.772299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-c665742e-7484-4da7-983d-1c23272c1536 req-94adfb46-52e3-48ad-92c7-af7751300ab5 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.788570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-c665742e-7484-4da7-983d-1c23272c1536 req-94adfb46-52e3-48ad-92c7-af7751300ab5 service nova] Creating event network-vif-deleted:7ef6f233-e8a9-46ca-913a-804b61bdeb70 for instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 on hv-cinder-82880 Sep 13 19:53:51.790096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:51.799544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-c665742e-7484-4da7-983d-1c23272c1536 req-94adfb46-52e3-48ad-92c7-af7751300ab5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047916 Sep 13 19:53:51.800778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 320/639] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:51.805531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e131fe22-ede7-4c20-90de-1e4a9339562a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 200 len: 1607 microversion: 2.1 time: 0.112389 Sep 13 19:53:51.814500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 320/640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:51 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 1607 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:51.926246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:51.927239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:51.934702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.936173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.936808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.937728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.938361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.938977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.112874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:52.120887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-160427c8-3a7f-4edb-89ca-cee73f4c0d1e tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1507 microversion: 2.1 time: 0.207361 Sep 13 19:53:52.121793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 321/641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:51 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:52.146475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58158faa-6f98-4b2a-bf1f-abd43e7d22a6", "device": "/dev/sdb"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:52.149405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:52.156371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.156889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.157323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.158285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.158741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.159168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.159900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:52.160540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:52.172481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.174222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.175124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.176363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.177074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.178020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.240276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bc649926-db95-4b18-a988-d04d67e16327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/ips" status: 200 len: 148 microversion: 2.1 time: 0.086364 Sep 13 19:53:52.241270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 322/642] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:53:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/ips => generated 148 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:53:52.726706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d66cefd3-9f24-401b-b292-7783a677fd9f tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "POST /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.586913 Sep 13 19:53:52.727473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 321/643] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:53:52 2022] POST /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:52.831089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:52.832780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:52.841421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.842627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.843061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.843815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.844268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.844767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.861479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 HTTP/1.1 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:53:52.863760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 19:53:52.865560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '3965b308-7b06-4c6b-8cf6-a14e471c13b9'} Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:53:52.866381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 19:53:52.867683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:53:52.868852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:53:52.868852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9895155-4880-4425-aef0-c4b2b4411381 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 404 len: 111 microversion: 2.1 time: 0.040054 Sep 13 19:53:52.868852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 323/644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:52 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:53:52.879708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c0db5efb-061f-4472-8ba8-c8b5c41dfb87 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '.version_select at 0x7f67650c1ca0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:52.903850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c0db5efb-061f-4472-8ba8-c8b5c41dfb87 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215205948" status: 202 len: 0 microversion: 2.1 time: 0.032277 Sep 13 19:53:52.908328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 322/645] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 19:53:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215205948 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:53:53.504333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f5db6296-abd4-4542-a804-619428e8ce7b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'create', calling method: .version_select at 0x7f6764fe48b0>, body: {"keypair": {"name": "tempest-keypair-1482795750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKo430llN5p/7/hnKRNUc6oe7xWkF5rOb9FfHcBvyZPHALJMsKWj0ejyv+xm/XsyR48Zd/+b0DEtRRPafwkHylAi7FXkVB+mlywktvX0wb2hHMtt1xDFzlDYBJ19wO5akA=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:53.509530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:53.523716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-f5db6296-abd4-4542-a804-619428e8ce7b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for project 2981eddb8742492fac516851f761e2f9. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:53.529026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-f5db6296-abd4-4542-a804-619428e8ce7b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for user 15069aa932aa473983c4102961b855d5 and project 2981eddb8742492fac516851f761e2f9. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:53.551641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f5db6296-abd4-4542-a804-619428e8ce7b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051069 Sep 13 19:53:53.552232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 324/646] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 19:53:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:53.594062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2034bdf-81ff-4d3b-b517-db1ed6e0f008"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:53.596503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:53.603504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:53.604207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:53.604638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:53.605324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:53.605858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:53.606272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:53.878756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5ed409ec-b5c4-4c30-be4e-3c1ad34e3ea4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288768 Sep 13 19:53:53.879722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 323/647] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:53:53 2022] POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:54.832081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1624512081", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fc9e9d4-f535-4573-a302-00c9e4db1969"}], "security_groups": [{"name": "tempest-securitygroup--1839685409"}], "key_name": "tempest-keypair-1482795750", "user_data": "}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:54.935943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] validate_networks() for [('7fc9e9d4-f535-4573-a302-00c9e4db1969', None, None, None, None, None)] {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:53:55.295724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:53:55.296137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:53:55.296601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:53:55.296996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:53:55.297390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:53:55.306717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.307185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.307771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.308537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.308977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.309391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.326173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for project 2981eddb8742492fac516851f761e2f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:55.330027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Getting quotas for user 15069aa932aa473983c4102961b855d5 and project 2981eddb8742492fac516851f761e2f9. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:55.340721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:53:55.343252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:53:55.390860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-50b1d557-0263-4b44-9083-bba9350030d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562901 Sep 13 19:53:55.391516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 325/648] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 19:53:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:53:55.403505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0805d36c-237f-4826-b97e-80f795dfe4fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:55.404915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0805d36c-237f-4826-b97e-80f795dfe4fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:55.466338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0805d36c-237f-4826-b97e-80f795dfe4fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:55.473173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0805d36c-237f-4826-b97e-80f795dfe4fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1238 microversion: 2.1 time: 0.074267 Sep 13 19:53:55.473757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 324/649] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:55 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:56.496164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:56.496685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:56.503429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.503904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.504333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.505002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.505444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.505889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.567686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:56.580088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d0b32fc4-af93-4493-a950-412cec8082bb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1290 microversion: 2.1 time: 0.088285 Sep 13 19:53:56.581080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 326/650] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:56 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:57.604241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:57.605166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:57.607808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:57.614512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.615003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.615438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.616138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.616591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.617024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.882421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:57.890814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d24d27fb-ca1d-49c1-867b-19ee2ded8f95 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.290416 Sep 13 19:53:57.891384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 325/651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:57 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:58.194885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-6afe66d3-ceac-4bf7-bd4c-09dc23f9472f req-32bb0431-bb19-4982-8c52-f0b247ab0b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9496396-f352-4a04-8d1d-f677e8315b96", "tag": "874a4f76-0f06-4864-a118-ae7e88a0170c"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:58.207508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6afe66d3-ceac-4bf7-bd4c-09dc23f9472f req-32bb0431-bb19-4982-8c52-f0b247ab0b24 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.207990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6afe66d3-ceac-4bf7-bd4c-09dc23f9472f req-32bb0431-bb19-4982-8c52-f0b247ab0b24 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.208441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-6afe66d3-ceac-4bf7-bd4c-09dc23f9472f req-32bb0431-bb19-4982-8c52-f0b247ab0b24 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.220009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-6afe66d3-ceac-4bf7-bd4c-09dc23f9472f req-32bb0431-bb19-4982-8c52-f0b247ab0b24 service nova] Creating event network-changed:874a4f76-0f06-4864-a118-ae7e88a0170c for instance f9496396-f352-4a04-8d1d-f677e8315b96 on hv-cinder-82880 Sep 13 19:53:58.224975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-6afe66d3-ceac-4bf7-bd4c-09dc23f9472f req-32bb0431-bb19-4982-8c52-f0b247ab0b24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 Sep 13 19:53:58.225794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 327/652] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:58.914456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:58.915361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:58.924920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.925539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.926149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.926872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.927536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.928118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:59.070896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:59.079050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ca6e7e08-419e-4d08-abd2-94000fed95ae tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.168944 Sep 13 19:53:59.079635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 326/653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:58 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:00.103125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:00.103816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:00.110713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.111193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.111626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.112307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.112757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.113182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.300547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:00.308600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-179bb2e0-18d3-470e-b7f4-dd86e1f3e163 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.210120 Sep 13 19:54:00.309182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 328/654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:00 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:01.331125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:01.331735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:01.338133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.338617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.339050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.339731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.340176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.340594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.474040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:01.481735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8621cd10-e8f5-481d-a139-b1f5ae3e99d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.154299 Sep 13 19:54:01.482302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 327/655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:01 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:02.504503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:02.505132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:02.511581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.512054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.512482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.513154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.513598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.514033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.644758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:02.652249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-39c7dcc0-13df-4c38-b610-74dfc0d638d5 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.151510 Sep 13 19:54:02.652814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 329/656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:02 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:03.678854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:03.680061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:03.690128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.690867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.691548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.692474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.693137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.693730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.781396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-47d27227-9441-4d35-b33a-4bf105f6b22e req-303094b0-bf2a-4dc2-9d20-459ae168b518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9496396-f352-4a04-8d1d-f677e8315b96", "name": "network-vif-plugged", "status": "completed", "tag": "874a4f76-0f06-4864-a118-ae7e88a0170c"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:03.792422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-47d27227-9441-4d35-b33a-4bf105f6b22e req-303094b0-bf2a-4dc2-9d20-459ae168b518 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.793420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-47d27227-9441-4d35-b33a-4bf105f6b22e req-303094b0-bf2a-4dc2-9d20-459ae168b518 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.794107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-47d27227-9441-4d35-b33a-4bf105f6b22e req-303094b0-bf2a-4dc2-9d20-459ae168b518 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.808760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-47d27227-9441-4d35-b33a-4bf105f6b22e req-303094b0-bf2a-4dc2-9d20-459ae168b518 service nova] Creating event network-vif-plugged:874a4f76-0f06-4864-a118-ae7e88a0170c for instance f9496396-f352-4a04-8d1d-f677e8315b96 on hv-cinder-82880 Sep 13 19:54:03.816341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-47d27227-9441-4d35-b33a-4bf105f6b22e req-303094b0-bf2a-4dc2-9d20-459ae168b518 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039354 Sep 13 19:54:03.817227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 330/657] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:03.869291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:03.877884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-74c48e0f-44c4-4023-b038-b82d0945adfc tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.205944 Sep 13 19:54:03.878448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 328/658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:03 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:04.900724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:04.901406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:04.908506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:04.908975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:04.909398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:04.910096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:04.910537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:04.910953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:05.041788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:05.049577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d3f042d6-b1d9-4fef-a796-2ab75352dd1b tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.153041 Sep 13 19:54:05.050166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 331/659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:04 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:06.071981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:06.072517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:06.074922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:06.080001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.080483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.080915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.081601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.082068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.082488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.214551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:06.223081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-140302cf-73fc-4d35-9147-2b6341c35772 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1364 microversion: 2.1 time: 0.155016 Sep 13 19:54:06.223650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 329/660] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:06 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:06.616485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:06.616986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:06.620964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:06.622375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=10 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:06.628769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.629179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.629591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.630860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.631889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.631889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.657732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:54:06.730969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e7e67935-d7ab-4d48-b698-e206074f77eb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 204 len: 0 microversion: 2.1 time: 0.117926 Sep 13 19:54:06.731548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 332/661] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 19:54:06 2022] DELETE /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:54:06.740205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:06.740803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:06.746651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.747645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.748071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.748736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.749174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.749588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.886189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:06.888377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:06.895001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fa548a0d-100a-44db-855a-161032fb8564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.158778 Sep 13 19:54:06.895582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 330/662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:07.247278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:07.248148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:07.253908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.254387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.254815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.255491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.255936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.256353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.384108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:07.392378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a39937c2-6413-43e1-a804-a0eb390c8828 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1551 microversion: 2.1 time: 0.149402 Sep 13 19:54:07.392952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 333/663] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:07 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:07.414560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:07.415072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:07.422788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.423259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.423687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.424359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.424804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.425220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.500759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e4c7c795-70ac-4a1d-8156-381c871e3ab6 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089937 Sep 13 19:54:07.501349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 331/664] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 19:54:07 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:07.917733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:07.919221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:07.925496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.926073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.926500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.927172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.927611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.928021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:08.170868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:08.178561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d8349324-87d7-4928-b2fc-4a664653f4d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.264689 Sep 13 19:54:08.179129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 334/665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:08.734660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-255648e7-36d3-4129-bfe3-a6b604be74c9 req-84061f30-8b73-4147-82db-1d15eb211158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9496396-f352-4a04-8d1d-f677e8315b96", "tag": "874a4f76-0f06-4864-a118-ae7e88a0170c"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:08.743930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-255648e7-36d3-4129-bfe3-a6b604be74c9 req-84061f30-8b73-4147-82db-1d15eb211158 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:08.744399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-255648e7-36d3-4129-bfe3-a6b604be74c9 req-84061f30-8b73-4147-82db-1d15eb211158 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:08.744822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-255648e7-36d3-4129-bfe3-a6b604be74c9 req-84061f30-8b73-4147-82db-1d15eb211158 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:08.755950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-255648e7-36d3-4129-bfe3-a6b604be74c9 req-84061f30-8b73-4147-82db-1d15eb211158 service nova] Creating event network-changed:874a4f76-0f06-4864-a118-ae7e88a0170c for instance f9496396-f352-4a04-8d1d-f677e8315b96 on hv-cinder-82880 Sep 13 19:54:08.761253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-255648e7-36d3-4129-bfe3-a6b604be74c9 req-84061f30-8b73-4147-82db-1d15eb211158 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030631 Sep 13 19:54:08.762053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 332/666] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:09.201921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:09.202525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:09.208873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:09.209344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:09.209801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:09.210478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:09.210921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:09.211333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:09.346921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:09.354824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3e3151e1-c92e-4ae1-9b0b-53e2c1bcc3ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.157357 Sep 13 19:54:09.355781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 335/667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:10.379997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:10.380696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:10.387436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.387919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.388358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.389044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.389497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.389961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.519596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:10.527463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a91b07a0-6539-49d6-a76e-a09ed2c5d3d0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.151712 Sep 13 19:54:10.528023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 333/668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:11.095384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:11.095892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:11.102180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.102654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.103084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.103754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.104197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.104613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.121036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:11.187764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'services' on Instance uuid 10efef25-2b14-468a-9a72-0e6412d56a07 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:54:11.259761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-64b4c752-b666-4bb4-be9a-18f0d361624d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments/1623d753-99ff-44fc-823c-cc29b59f63cb" status: 202 len: 0 microversion: 2.1 time: 0.168599 Sep 13 19:54:11.260360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 336/669] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 19:54:11 2022] DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments/1623d753-99ff-44fc-823c-cc29b59f63cb => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:54:11.269248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:11.271452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:11.277346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.277865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.278302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.278986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.279438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.279861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.308942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-85f54aa5-a80a-4152-8b4d-c8fe1ad44281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Sep 13 19:54:11.309476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 334/670] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:11.552151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:11.552754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:11.558962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.559430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.559855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.560522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.560958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.562019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.696981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:11.704686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7682045f-318d-496c-ae64-cbb908d72cb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.156860 Sep 13 19:54:11.705247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 337/671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:12.321516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:12.323663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:12.330583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.331060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.331493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.332168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.332612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.333031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.361966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b1981fae-0d43-46d1-98a6-eb405ab5bc13 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Sep 13 19:54:12.362513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 335/672] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:12.727074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:12.727630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:12.734501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.734983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.735416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.736096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.736543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.736958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.863762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:12.871407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-af96939e-aeec-43f5-90d9-57bae7070ad6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.148135 Sep 13 19:54:12.871972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 338/673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:13.374217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:13.376502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:13.383450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.383923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.384353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.385025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.385463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.385902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.414719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-21e504fe-9990-4a8d-9e1f-5fda99ee872a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Sep 13 19:54:13.415267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 336/674] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:13.894975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:13.895659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:13.901962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.902433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.902858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.903549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.903973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.904388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.037469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.045587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d2c276c-9b28-4695-9348-d093518027bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154355 Sep 13 19:54:14.046256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 339/675] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:14.427214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:14.429337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:14.435636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.437183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.437661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.438340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.438785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.439202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.467949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a5719888-2e4d-4c24-8284-09cb6e28346f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Sep 13 19:54:14.468497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 337/676] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:15.068243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.068789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.075209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.075689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.076122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.076800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.077247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.077692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.209194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.217797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3497c705-619c-4039-907b-b9dac83b6dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.152864 Sep 13 19:54:15.218360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 340/677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:15.480199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.482390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.488700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.489177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.489623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.490305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.490749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.491170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.520492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-296ef6d3-f49f-45e7-b5b8-5aa36d3022fe tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Sep 13 19:54:15.521037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 338/678] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:16.241078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:16.241704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:16.247988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.248460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.248884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.249551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.250017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.250432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.382890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:16.391107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-828cc7de-532f-4f78-93c0-171aa124efae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.153860 Sep 13 19:54:16.391680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 341/679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:16.533005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:16.535200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:16.541591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.542101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.542781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.543465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.543913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.544333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.573900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d0a510b9-239f-45b8-bbd0-a3ea938e8e21 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Sep 13 19:54:16.574503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 339/680] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:17.413513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:17.414154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:17.421755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.422236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.422662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.423336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.423778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.424189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.557901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:17.567902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c67d37d8-ca0c-4d11-a2ec-5745b8248ac3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.158234 Sep 13 19:54:17.568468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 342/681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:17.587057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:17.589334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:17.595725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.596199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.596629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.597303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.597809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.598228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.629927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8feece85-89d4-4df3-9f51-9b341292bb8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Sep 13 19:54:17.630491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 340/682] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:18.594842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:18.595391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:18.601300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.601810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.602239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.602905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.603344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.603755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.642070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:18.644186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:18.650519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.650996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.651423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.652107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.652550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.652963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.682715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ac66944b-ce95-4d2d-b2e5-fad2846de132 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Sep 13 19:54:18.683292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 341/683] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:18.735677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.743478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b3ceea9a-50f0-4920-9f0e-6c58b5eec731 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.153350 Sep 13 19:54:18.744050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 343/684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:19.696479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:19.698627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:19.705124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.705597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.706056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.706778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.707219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.707637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.737923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7e2f9d8d-3af8-4b03-9689-330debd9dc5a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Sep 13 19:54:19.738476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 342/685] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:19.767675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:19.768278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:19.774789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.775269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.775701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.776465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.776919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.777344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.913954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:19.922222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-16179e7b-1ea6-4aeb-aa33-6a5561d957d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.158867 Sep 13 19:54:19.923083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 344/686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:20.750529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:20.752652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:20.759038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.759515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.759949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.760631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.761078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.761498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.791115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d7a2440a-72a7-4a97-90a1-73f07a5244d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 13 19:54:20.791675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 343/687] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:20.944669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:20.945361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:20.952681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.953379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.953856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.954557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.955009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.955436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:21.085217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:21.093013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0b3049c1-5ae3-4aa0-9025-cac8fa34e5fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.152177 Sep 13 19:54:21.093588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 345/688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:21.803993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:21.806112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:21.812540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:21.813020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:21.813451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:21.814233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:21.814680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:21.815126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:21.845068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-060f2a20-67d1-4dbe-9659-502a8ba6b02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Sep 13 19:54:21.845698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 344/689] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:22.116048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:22.116650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:22.123941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.124435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.124850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.125531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.126004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.126425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.258229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:22.265953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3c3629da-763e-47b7-b277-5b6a49d177ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.153725 Sep 13 19:54:22.266516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 346/690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:22.857815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:22.860010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:22.866510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.866993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.867426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.868110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.868585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.869119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.900872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-207f8753-7aa2-4780-bf9f-4715b1a84e9e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Sep 13 19:54:22.901447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 345/691] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:23.288242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:23.288846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:23.295722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.296201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.296742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.297599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.298396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.299087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.435993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:23.446099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-80b308f2-8631-4da5-9b23-a574463a6c55 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.161261 Sep 13 19:54:23.446731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 347/692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:23.913929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:23.916070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:23.923322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.923805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.924239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.924918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.925367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.925886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.954397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6158979-b547-4907-9b74-e8860bbbe047 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Sep 13 19:54:23.954949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 346/693] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:24.470482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:24.471127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:24.473581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:24.478632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.479109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.479539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.480221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.480664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.481087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.612430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:24.620133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-70597a35-839b-49b2-8cbd-ff95ae064079 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154464 Sep 13 19:54:24.620698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 348/694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:24.966769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:24.968897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:24.977369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.977868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.978301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.978989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.979413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.979829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.011620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-830b1911-ad95-487f-93e4-96a01a55dcd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048751 Sep 13 19:54:25.012174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 347/695] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:25.643073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:25.643667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:25.650273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.650749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.651172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.651842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.652283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.652694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.790775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:25.799033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2559ea67-cc4a-4fee-9759-14bf63b6fa12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.159797 Sep 13 19:54:25.799611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 349/696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:26.024306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:26.026482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:26.033479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.034000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.034437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.035125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.035579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.036006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.049733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:26.065880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a255e10b-4f23-4d88-8afc-c3a67e2fdc3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Sep 13 19:54:26.066438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 348/697] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:26.821818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:26.822463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:26.829846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.830002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.830357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.831054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.831561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.831988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.959271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:26.966874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-97754270-770d-4c6a-b15e-f6bdbc25001e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.148900 Sep 13 19:54:26.967443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 350/698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:27.079337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:27.081436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:27.087951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.088431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.088869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.089541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.090008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.090423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.118411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f8da5d42-ebfa-4abc-8114-efe8c8f2e3b4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043834 Sep 13 19:54:27.118961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 349/699] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:27.989795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:27.990401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:27.996915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.997395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.998502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.999203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.999651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.000068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.131633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:28.133840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:28.136399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=50 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:28.141738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.142231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.142690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.143380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.143510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:28.143829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.144257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.151419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f22e90a-449b-4ec7-b481-4610e245a676 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.165458 Sep 13 19:54:28.152160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 351/700] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:28.177508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b78e1669-01c2-49d1-b14d-f9f6f46ed293 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049907 Sep 13 19:54:28.178147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 350/701] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:29.173659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:29.174219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:29.180568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.180974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.181401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.182201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.182649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.183069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.190477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:29.192627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:29.198768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:29.199087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.199573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.200102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.201031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.202181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.202693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.232895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fbfb7ddf-0a39-40ed-aa5a-d17dc32d9939 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046320 Sep 13 19:54:29.233476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 351/702] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:29.318504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:29.326773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6f0a598a-f2f3-4548-8ae6-56fba099f617 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.156502 Sep 13 19:54:29.327339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 352/703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:30.245082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:30.247417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:30.253787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.254270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.254703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.255389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.255835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.256257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.285682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e1928cfe-4e90-4924-a371-3cfb78a1d5a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 13 19:54:30.286226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 352/704] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:30.348506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:30.349214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:30.355555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.356025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.356454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.357170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.357633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.358050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.485814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:30.493364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1b1a6f65-5c7a-492a-8304-0336227a5d30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.148652 Sep 13 19:54:30.494008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 353/705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:30.948687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:30.949170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:30.955633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.956106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.956536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.957207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.957669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.958086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.980345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ac489f98-cae3-46ad-9acd-b874baee8f7e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4/ips" status: 200 len: 150 microversion: 2.20 time: 0.087953 Sep 13 19:54:30.980873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 353/706] 10.222.0.23 () {60 vars in 1289 bytes} [Tue Sep 13 19:54:30 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4/ips => generated 150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:54:31.299503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:31.301784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:31.307546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:31.308017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:31.308441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:31.309111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:31.309551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:31.310016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:31.339134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b1bf51ff-cb57-485e-a881-27cf5fd3dfb7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Sep 13 19:54:31.339681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 354/707] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:31.515384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:31.515925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:31.522285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:31.522756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:31.523186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:31.523854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:31.524296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:31.524711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:31.659120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:31.666729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a56bf05-aff8-4c63-b1b6-6bc126acd96d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.155329 Sep 13 19:54:31.667556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 354/708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:32.351965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:32.354202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:32.360636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.361120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.361551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.362298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.362745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.363166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.392612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0642c52c-3d36-4760-9ace-0aa1f2ba03fa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Sep 13 19:54:32.393163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 355/709] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:32.690733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:32.691481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:32.697952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.698479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.698903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.699580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.700021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.700438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.829937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:32.839264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b6b20550-9c3c-449a-9175-a02124d5fcaa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.152376 Sep 13 19:54:32.839830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 355/710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:33.405084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:33.407251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:33.413614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.414137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.414574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.415253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.415699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.416118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.448682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-af3a7005-9cae-4603-85c1-1bba07d2d9d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048113 Sep 13 19:54:33.449449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 356/711] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:33.862888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:33.863501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:33.870342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.870821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.871257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.871973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.872428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.873344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:34.004966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:34.012829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-158a139c-b4d0-4511-bc2c-a44fd15c6e71 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.153801 Sep 13 19:54:34.013469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 356/712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:34.460984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:34.463090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:34.469918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:34.470403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:34.470837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:34.471515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:34.471960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:34.472383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:34.502617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9d0cda2-99d6-4077-9281-7de9935c9306 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045577 Sep 13 19:54:34.503175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 357/713] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:35.035981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:35.036573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:35.043188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:35.043660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:35.044091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:35.044764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:35.045210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:35.045648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:35.176026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:35.183611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0da80d70-9b14-4cb1-b24e-c0f36dda3614 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.151454 Sep 13 19:54:35.184168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 357/714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:35.516311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:35.519330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:35.526859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:35.527257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:35.527695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:35.528393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:35.529405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:35.529860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:35.560728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-51910119-d51c-462a-96f2-b5557c50abd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050191 Sep 13 19:54:35.561289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 358/715] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:35 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:36.209225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:36.209856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:36.216714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.217190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.217632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.218308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.218749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.219166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.350336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:36.358187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6ae638d6-12da-4d01-bdd5-bffa8ec02434 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.152841 Sep 13 19:54:36.358742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 358/716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:36.573283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:36.575521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:36.582513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.582989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.583424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.584114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.584560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.584978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.614828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0b7bb8a4-253f-4cba-8c8e-abe46fccf342 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Sep 13 19:54:36.615384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 359/717] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:37.380820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:37.381296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:37.387919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:37.388403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:37.388835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:37.389513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:37.389988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:37.390407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:37.524199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:37.532439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f2100ab2-d077-4965-8b4b-c976c0b35283 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.155560 Sep 13 19:54:37.532996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 359/718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:37.627817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:37.630316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:37.636768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:37.637163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:37.637587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:37.638678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:37.639345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:37.639345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:37.672065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-347b516f-0ad6-439c-b484-f79a49abd03f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048385 Sep 13 19:54:37.672619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 360/719] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:38.555622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:38.556229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:38.563094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:38.563572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:38.564005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:38.564683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:38.565149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:38.565551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:38.684546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:38.687221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:38.693663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:38.694153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:38.694592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:38.695241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:38.695375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:38.695723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:38.696148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:38.703447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d7ef408e-3d81-47af-9458-8d88600726dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.151604 Sep 13 19:54:38.704240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 360/720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:38.725988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-39fd29a1-c5d5-4d88-9f81-9ff4b530f667 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Sep 13 19:54:38.726557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 361/721] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:39.726293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:39.726837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:39.733431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:39.733952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:39.734386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:39.735078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:39.735527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:39.735947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:39.738178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:39.740339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:39.746387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:39.746860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:39.747782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:39.748454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:39.748899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:39.749311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:39.778824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7a69df39-95ec-4f82-9f3a-668965010f68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Sep 13 19:54:39.779423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 362/722] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:39.870958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:39.879461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c2ee9a62-e923-4495-ae1c-1bafc7d33780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.157016 Sep 13 19:54:39.880035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 361/723] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:40.791255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:40.793707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:40.800690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:40.801175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:40.801629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:40.802349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:40.802800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:40.803222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:40.832364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-183edec2-1cbd-496a-a2d9-38d57cb03608 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Sep 13 19:54:40.832914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 363/724] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:40.902112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:40.902724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:40.909073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:40.909551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:40.910017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:40.910696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:40.911144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:40.911566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:41.041140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:41.050699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e5bc1f82-1a6a-4163-a50e-7083c35ba51b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.152364 Sep 13 19:54:41.051200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 362/725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:41.844871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:41.847003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:41.853427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:41.853937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:41.854371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:41.855048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:41.855493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:41.855911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:41.884837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-11490277-e45a-4ee6-8aa0-f044452c0102 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Sep 13 19:54:41.885386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 364/726] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:42.073762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:42.074368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:42.081506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:42.082032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:42.082461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:42.083130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:42.083572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:42.083986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:42.216484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:42.224135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-afe5370d-6161-4e01-a8f6-15c5b22266bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154184 Sep 13 19:54:42.224699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 363/727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:42.897842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:42.899963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:42.906884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:42.907364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:42.907798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:42.908477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:42.908927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:42.909344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:42.938531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-278aeb11-d1a0-4376-a114-93f57968bba9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Sep 13 19:54:42.939080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 365/728] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:43.247745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:43.248390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:43.254837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:43.255313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:43.255740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:43.256414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:43.256855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:43.257271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:43.386529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:43.394797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-048fc045-f923-4c8b-bf71-27f498abe96c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.150943 Sep 13 19:54:43.395376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 364/729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:43.950565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:43.952727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:43.959169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:43.959653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:43.960096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:43.960778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:43.961230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:43.961686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:43.990750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f92bbe1-01f7-46bf-b132-d158a3430c52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Sep 13 19:54:43.991296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 366/730] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:44.416785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:44.417696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:44.424166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:44.424649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:44.425087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:44.425802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:44.426255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:44.426679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:44.441755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:44.533317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:44.533839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:44.539804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:44.540277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:44.540702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:44.541376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:44.542116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:44.542533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:44.559279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:44.566900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b2ba4c8e-37d6-4f1b-b0b6-db5b567e5ebb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96/ips" status: 200 len: 107 microversion: 2.1 time: 0.093004 Sep 13 19:54:44.567457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 367/731] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 19:54:44 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96/ips => generated 107 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:44.567747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9c5f641b-826f-4961-92f7-a83307f8ee43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154834 Sep 13 19:54:44.568303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 365/732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:45.003084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:45.005233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:45.011805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:45.012318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:45.012757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:45.013451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:45.013935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:45.014360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:45.045053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b9b01aed-2d07-465e-8cae-df560c52d2b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045982 Sep 13 19:54:45.045624 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 368/733] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:45.590674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:45.591963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:45.598610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:45.599083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:45.599509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:45.600187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:45.600623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:45.601039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:45.735328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:45.743195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c2eda016-1585-4dad-8173-0f74c7e1ef68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.156382 Sep 13 19:54:45.743747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 366/734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:46.056618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:46.058791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:46.065738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:46.066212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:46.066639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:46.067306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:46.067744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:46.068157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:46.081875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:46.099110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f6863c4-4e1d-4f4a-a1c5-61692e431175 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046460 Sep 13 19:54:46.099598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 369/735] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:46.766618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:46.767230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:46.773303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:46.773896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:46.774348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:46.775033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:46.775487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:46.775910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:46.904573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:46.912455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5eba17c0-1418-4f25-b274-e16281e7b451 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.149657 Sep 13 19:54:46.913023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 367/736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:47.111850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:47.113974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:47.120219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.120689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.121123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.121814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.122256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.122671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.301269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4b48b36f-7fb4-4a76-abbf-a085c07d831a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193273 Sep 13 19:54:47.301856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 370/737] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:47.936411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:47.936922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:47.943400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.943879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.944311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.944992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.945439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.945889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:48.090150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:48.098138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3f3ee2c9-aff8-4153-b0be-eecaee586580 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.166137 Sep 13 19:54:48.098716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 368/738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:48.314237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:48.316240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:48.322788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:48.323262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:48.323692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:48.324357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:48.324797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:48.325215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:48.358733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a3aef2da-67d8-476d-993e-49c94b4cb647 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049006 Sep 13 19:54:48.359281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 371/739] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:49.120284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:49.123015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:49.129546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:49.130090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:49.130524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:49.131206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:49.131664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:49.132074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:49.260294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:49.267984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e34fabe4-72d7-4459-89c9-ec67f727d68e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.151814 Sep 13 19:54:49.268547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 369/740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:49.370756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:49.372941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:49.378858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:49.379333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:49.379762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:49.380432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:49.380873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:49.381292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:49.409854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-620c9988-ff22-4872-8fab-6a349cc9f999 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043160 Sep 13 19:54:49.410392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 372/741] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:50.290178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:50.290720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:50.297467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:50.297981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:50.298420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:50.299112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:50.299566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:50.299993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:50.422281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:50.424414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:50.430701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:50.431183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:50.431615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:50.432304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:50.432747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:50.432860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:50.433165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:50.441117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-388d1061-54db-4c26-8eb7-72099fefe424 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154922 Sep 13 19:54:50.441712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 370/742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:50.463419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-339399fd-5405-4ff7-81a7-215fc6570514 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045308 Sep 13 19:54:50.463958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 373/743] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:51.464340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:51.464873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:51.472195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:51.472679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:51.473116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:51.473829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:51.474288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:51.474716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:51.475810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:51.477983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:51.484353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:51.484832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:51.485266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:51.485971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:51.486414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:51.486832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:51.516215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d6bb90b4-56fe-41f7-b1b4-2cfe6d168d57 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Sep 13 19:54:51.516772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 374/744] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:51.609391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:51.617053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e22c3d62-3d96-42ae-ad85-b5b90509d7a9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.156668 Sep 13 19:54:51.617641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 371/745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:52.529536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:52.531622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:52.538099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.538584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.539018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.539847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.540297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.540735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.570351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3ff65669-a210-40e0-aef1-0cd24dcbe0d6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Sep 13 19:54:52.570886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 375/746] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:52.640172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:52.640802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:52.647209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.647691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.648120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.648802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.649249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.649696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.779423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:52.788122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2017620c-8e63-4ade-9e69-4f421327893d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.151784 Sep 13 19:54:52.788622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 372/747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:53.583260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:53.585288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:53.591742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:53.592217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:53.592643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:53.593314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:53.593786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:53.594227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:53.625037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0f39601f-b9e4-4fbc-a4c2-174aace6a0e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Sep 13 19:54:53.625572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 376/748] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:53.812086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:53.812699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:53.819265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:53.819747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:53.820178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:53.820863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:53.821308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:53.821762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:53.953355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:53.961090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9b2b6ef1-e13e-41c0-8e56-37ea1ab8b61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.153942 Sep 13 19:54:53.961671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 373/749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:54.638214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:54.640335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:54.643774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=58 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:54.647563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.648048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.648485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:54.649171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.649642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.650076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:54.679398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f6517820-4ab7-473d-a7e3-2b55e8246864 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045690 Sep 13 19:54:54.679965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 377/750] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:54.984635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:54.985241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:54.991662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.992139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.992573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:54.993250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.993754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.994153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:55.122166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:55.130335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-65840184-8026-409e-b27f-268d3057a022 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.150052 Sep 13 19:54:55.130903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 374/751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:55.692076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:55.694254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:55.702566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:55.703387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:55.704185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:55.705337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:55.706140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:55.706817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:55.739705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9376017b-6a7c-41a4-a747-626f67497917 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051581 Sep 13 19:54:55.740266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 378/752] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:56.153542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:56.154188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:56.161047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:56.161528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:56.162030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:56.162717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:56.163163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:56.163582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:56.296671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:56.304298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5ad4bad0-836e-422a-91a1-3d5d1e7e2503 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154594 Sep 13 19:54:56.304862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 375/753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:56.752781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:56.754989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:56.761239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:56.761751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:56.762188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:56.762866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:56.763317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:56.763738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:56.797082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ebeaef6b-b52e-41b5-915f-6fdc8398adc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048786 Sep 13 19:54:56.797644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 379/754] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:57.326891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:57.327425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:57.333821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:57.334303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:57.334736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:57.335417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:57.335873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:57.336292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:57.469341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:57.477431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9eceaf12-b6b1-42e3-9fab-273c0e9985cc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.154528 Sep 13 19:54:57.478028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 376/755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:57.810134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:57.812782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:57.819289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:57.819776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:57.820210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:57.820898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:57.821346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:57.821903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:57.850794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-17ff1308-ff2b-43cc-b4b7-a1a6cf37b788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Sep 13 19:54:57.851341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 380/756] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:58.500668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:58.501268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:58.503621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=54 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:58.509077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:58.509558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:58.510008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:58.510697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:58.511143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:58.511769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:58.675986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:58.684492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-75f41885-21ac-447a-abbe-234ca3c333ca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.188111 Sep 13 19:54:58.689969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 377/757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:58.863946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:58.866070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:58.873930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:58.874405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:58.874833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:58.875508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:58.875947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:58.876359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:58.904667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4c729a1-2e25-42a9-871a-11ddd960069e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Sep 13 19:54:58.905213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 381/758] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:59.708844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:59.709587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:59.716203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:59.717498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:59.717954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:59.718808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:59.719478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:59.720236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:59.726672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2034bdf-81ff-4d3b-b517-db1ed6e0f008"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:59.729182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:59.736614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:59.737706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:59.738826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:59.739763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:59.740454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:59.741060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:59.852379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Invalid volume: volume a2034bdf-81ff-4d3b-b517-db1ed6e0f008 is already attached to instances: c4d5be8a-859b-4ba2-a738-a9fa561a778d Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments HTTP/1.1 Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 74 Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 19:54:59.855233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {"volumeAttachment": {"volumeId": "a2034bdf-81ff-4d3b-b517-db1ed6e0f008"}} Sep 13 19:54:59.856606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Invalid volume: volume a2034bdf-81ff-4d3b-b517-db1ed6e0f008 is already attached to instances: c4d5be8a-859b-4ba2-a738-a9fa561a778d Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': 'c4d5be8a-859b-4ba2-a738-a9fa561a778d', 'body': {'volumeAttachment': {'volumeId': 'a2034bdf-81ff-4d3b-b517-db1ed6e0f008'}}} Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2034bdf-81ff-4d3b-b517-db1ed6e0f008 is already attached to instances: c4d5be8a-859b-4ba2-a738-a9fa561a778d Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:54:59.857509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2034bdf-81ff-4d3b-b517-db1ed6e0f008 is already attached to instances: c4d5be8a-859b-4ba2-a738-a9fa561a778d Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:59.858879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:59.860157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:59.860157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:54:59.860157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:54:59.860157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2034bdf-81ff-4d3b-b517-db1ed6e0f008 is already attached to instances: c4d5be8a-859b-4ba2-a738-a9fa561a778d Sep 13 19:54:59.860157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 19:54:59.862613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 400 to user: Invalid volume: volume a2034bdf-81ff-4d3b-b517-db1ed6e0f008 is already attached to instances: c4d5be8a-859b-4ba2-a738-a9fa561a778d {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:54:59.863681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-855c67ef-418e-4d02-8559-38805a7ec77f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140832 Sep 13 19:54:59.864385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 382/759] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 19:54:59 2022] POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 174 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 19:54:59.916328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:59.918805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:59.927227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:59.927754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:59.928289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:59.929108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:59.929560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:59.930046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:00.000228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-26ece449-e963-4f03-be2e-5010a44adf86 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087691 Sep 13 19:55:00.000793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 383/760] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:54:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:00.005664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:00.006140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:00.015723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:00.016619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:00.017475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:00.018387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:00.019183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:00.019801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:00.031738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:00.039479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-65ab5fc4-bd94-4738-9d33-9bd8121bd333 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1577 microversion: 2.1 time: 0.335202 Sep 13 19:55:00.040562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 378/761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1577 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:00.131353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lazy-loading 'services' on Instance uuid c4d5be8a-859b-4ba2-a738-a9fa561a778d {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:00.206463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e3b2de25-ddbb-4d3d-99a2-73b84e2f5dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments/a2034bdf-81ff-4d3b-b517-db1ed6e0f008" status: 202 len: 0 microversion: 2.1 time: 0.204279 Sep 13 19:55:00.207784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 384/762] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 19:55:00 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments/a2034bdf-81ff-4d3b-b517-db1ed6e0f008 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:55:00.220212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:00.223082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:00.233194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:00.234104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:00.234756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:00.235653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:00.237016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:00.237942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:00.274385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-88a434ed-f84f-4ff4-bdbc-d24807a7280d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061639 Sep 13 19:55:00.279615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 379/763] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:00 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:01.013241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:01.016855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:01.025155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.025537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.026025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.026756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.027209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.027629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.047161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:01.069487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b3971239-9328-4f73-b05b-39b6d48ab0e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060603 Sep 13 19:55:01.073733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 385/764] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:01.075167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:01.075829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:01.082407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.082886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.083318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.084007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.084449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.084926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.127052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-f3e06626-a13a-4789-99a1-0fff0626b2ee req-1f18f88c-aa09-4dc8-9816-1fa09c4cb7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cbec662-02ef-44f0-9a02-f2b8090a5c1b", "name": "network-vif-deleted", "tag": "98859aeb-5541-4304-a25f-f45601b5d33d"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:01.142123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f3e06626-a13a-4789-99a1-0fff0626b2ee req-1f18f88c-aa09-4dc8-9816-1fa09c4cb7ae service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.142963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f3e06626-a13a-4789-99a1-0fff0626b2ee req-1f18f88c-aa09-4dc8-9816-1fa09c4cb7ae service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.143633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f3e06626-a13a-4789-99a1-0fff0626b2ee req-1f18f88c-aa09-4dc8-9816-1fa09c4cb7ae service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.155125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:01.159150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-f3e06626-a13a-4789-99a1-0fff0626b2ee req-1f18f88c-aa09-4dc8-9816-1fa09c4cb7ae service nova] Creating event network-vif-deleted:98859aeb-5541-4304-a25f-f45601b5d33d for instance 0cbec662-02ef-44f0-9a02-f2b8090a5c1b on hv-cinder-82880 Sep 13 19:55:01.164075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-da9f08a9-cb43-4dc1-b4bf-6d9f33f7434d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092328 Sep 13 19:55:01.169772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 386/765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:01.170271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-f3e06626-a13a-4789-99a1-0fff0626b2ee req-1f18f88c-aa09-4dc8-9816-1fa09c4cb7ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118623 Sep 13 19:55:01.170271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 380/766] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:01.287257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:01.289747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:01.296519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.297032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.297468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.298187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:01.298634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:01.299064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:01.329064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-55dc8242-094d-438e-abea-02d7a1c1cbcc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Sep 13 19:55:01.329636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 387/767] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:01 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:02.083867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:02.086931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:02.094956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:02.095620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:02.096248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:02.097140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:02.097642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:02.098067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:02.129149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3d0c8093-b170-4e3c-8542-6d6e570381a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049633 Sep 13 19:55:02.129773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 381/768] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:02.187108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:02.187711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:02.194043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:02.194530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:02.194948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:02.195644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:02.196087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:02.196498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:02.256507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:02.266078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ab942c8b-b460-494e-99b9-6084b7d8dbae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083197 Sep 13 19:55:02.266724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 388/769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:02.341973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:02.344062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:02.349978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:02.350456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:02.350888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:02.351656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:02.352106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:02.352528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:02.377311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:02.382402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a12e555c-a398-4d1c-8068-f05d12580600 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Sep 13 19:55:02.383054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 382/770] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:02 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:03.140878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:03.143185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:03.149079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:03.149554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:03.150020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:03.150723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:03.151164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:03.151658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:03.181882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dd5951cb-162d-47ca-81da-bfd132ca8f38 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Sep 13 19:55:03.182437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 389/771] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:03.288792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:03.289323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:03.296139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:03.296611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:03.297042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:03.297738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:03.298180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:03.298598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:03.361393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:03.369201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a5120197-38e0-468d-b678-e4e4f2c004b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084314 Sep 13 19:55:03.369780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 383/772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:03.395298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:03.397418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:03.403676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:03.404764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:03.405193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:03.405900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:03.406334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:03.406746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:03.435277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-90230790-9afc-4c29-8505-703cb22db9ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Sep 13 19:55:03.435819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 390/773] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:03 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:04.194818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:04.196945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:04.204322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:04.204815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:04.205320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:04.206052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:04.206967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:04.206967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:04.240166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f428559f-58bd-401f-b511-eb61eaa11c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049252 Sep 13 19:55:04.240716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 384/774] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:04.392114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:04.392723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:04.398647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:04.399230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:04.399538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:04.400220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:04.400665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:04.401082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:04.446697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:04.448913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:04.455595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:04.456070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:04.456495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:04.457169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:04.457636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:04.458049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:04.461975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:04.469874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b8a2839d-d105-4e59-ae75-5932db269af2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082262 Sep 13 19:55:04.470436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 391/775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:04.487088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a9743261-508e-426a-8146-b9bdf09e4843 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Sep 13 19:55:04.487630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 385/776] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:04 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:05.252482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:05.254658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:05.260546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.261028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.261461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.262170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.262617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.263037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.291921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-32ca2091-c741-4242-9a63-727bc4ff7808 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043088 Sep 13 19:55:05.292383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 392/777] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:05.492394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:05.493142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:05.499166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:05.499930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.500510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.501020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.501420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:05.501869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.502391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.503103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.508100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.508575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.509002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.509740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.510181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.510591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.542910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4ad97b9e-a60e-4c73-b368-f332c6022679 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 Sep 13 19:55:05.543582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 393/778] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:05 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:05.568610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:05.576955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-04cbb6a0-6d50-4382-9679-0da3527bc692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088506 Sep 13 19:55:05.577500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 386/779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:06.036904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:06.037434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:06.043802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.044332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.044714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.045392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.045876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.046297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.069187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lazy-loading 'flavor' on Instance uuid 11000afd-6551-4b16-81dd-f5905971fb0f {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:06.144712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cd162376-93b1-4e99-bea1-30a52df19fb3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "POST /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f/action" status: 202 len: 0 microversion: 2.1 time: 0.111447 Sep 13 19:55:06.145333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 394/780] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 19:55:06 2022] POST /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:55:06.157809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:06.158444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:06.165076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.165761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.166204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.167167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.167632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.168058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.305286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:06.306237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:06.307519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:06.314202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.314684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.315056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2c3dddbc-668a-4883-b4f9-1dcf971d3aa8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165225 Sep 13 19:55:06.315164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.315777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.315894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 387/781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:06.316217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.316630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.346510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-99adaf9f-c1d8-420e-b413-ccfa27a44779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Sep 13 19:55:06.347053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 395/782] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:06.555654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:06.558368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:06.565949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.566427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.566857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.567555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.568212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.568816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.599443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c7afb902-7675-4915-a606-067376f23b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048485 Sep 13 19:55:06.599992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 388/783] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:06 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:06.601712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:06.602321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:06.609217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.609724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.610161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.610841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.611294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.611714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.673282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:06.680989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ee7f4f49-005f-465b-958b-424eb89f523c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083212 Sep 13 19:55:06.681555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 396/784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:07.338931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:07.339568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:07.346317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.346795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.347219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.347897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.348438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.348859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.359428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:07.361799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:07.367728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.368223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.368715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.369419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.369896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.371039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.400706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c1cdb476-14fe-4181-b833-59fa671a7d0e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Sep 13 19:55:07.401822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 397/785] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:07.533039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:07.540905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e425837-918e-4688-afd9-7c2b82b9f3ba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.205951 Sep 13 19:55:07.541756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 389/786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:07.612651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:07.614819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:07.621405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.621910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.622361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.623040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.623479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.623892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.654934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-36ba6af4-f917-49c2-b058-e6266d660284 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Sep 13 19:55:07.655498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 398/787] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:07 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:07.704116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:07.704731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:07.711190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.711680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.712117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.712817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.713270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.713734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.775628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:07.783497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7de668a4-3f16-4b26-917e-5d637c2affed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083742 Sep 13 19:55:07.784010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 390/788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:08.413730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:08.415861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:08.422558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.423033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.423463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.424135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.424578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.425201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.454299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-762885bc-645b-4544-b5c8-74b7ca5ee19e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Sep 13 19:55:08.454843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 399/789] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:08.565788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:08.566405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:08.572455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.572937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.573376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.574083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.574536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.574960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.667647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:08.670293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:08.676344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.676819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.677245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.677951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.678398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.678829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.682661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:08.705328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:08.713290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e29eb4e3-e19c-4080-8e1d-d9fd6737cbbe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049881 Sep 13 19:55:08.713531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fd78cce5-8577-4189-9ada-ea5033f845a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151645 Sep 13 19:55:08.713886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 400/790] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:08 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:08.714302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 391/791] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:08.806459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:08.807069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:08.813525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.814037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.814476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.815159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.815612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.816035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.879646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:08.887406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b5643d5c-486d-4d42-bdff-67ebff59a788 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084741 Sep 13 19:55:08.887971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 401/792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:09.466729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.469008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.475113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.475593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.476025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.476706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.477151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.477573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.507659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0e226ff2-d019-42d1-9c9f-a31aac32f9b6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044938 Sep 13 19:55:09.508206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 392/793] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:09.725631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.727702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.734767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.735244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.735669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.736345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.736603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.737040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.737185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.737298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.743452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.743952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.744377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.745057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.745499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.745945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.767898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ae70d110-41d5-4543-9725-76c03d40b93b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046221 Sep 13 19:55:09.768503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 402/794] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:09 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:09.882423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:09.890168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c97a09bc-69a3-431f-b57b-a08596a27566 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157344 Sep 13 19:55:09.890731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 393/795] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:09.909989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.910595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.916789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.917265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.917720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.918395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.918844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.920028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.981939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:09.989570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-25ffd570-2ddf-43ae-a343-adcab57289c3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083373 Sep 13 19:55:09.990147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 403/796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:10.520275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:10.522365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:10.528330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:10.528827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:10.529257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:10.529978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:10.530432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:10.530857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:10.559381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-91cf3254-1596-4728-8b90-4d27c0ee9775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Sep 13 19:55:10.560440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 394/797] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:10.781152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:10.783317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:10.789178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:10.789681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:10.790112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:10.790780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:10.791477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:10.791890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:10.821369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-469bcdd5-d7d5-4f65-a577-61bdfb933dcb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Sep 13 19:55:10.821950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 404/798] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:10 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:10.913624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:10.914356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:10.921364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:10.921889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:10.922322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:10.923024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:10.923466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:10.923887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.011885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:11.012499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:11.018686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.019175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.019611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.020302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.020754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.021176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.074985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:11.082850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-519c00a9-c129-47a9-be4e-b46c4a85dd0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.173041 Sep 13 19:55:11.083427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 395/799] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:11.092814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:11.100605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d516e01c-704c-4016-b132-012ed036a780 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092552 Sep 13 19:55:11.101175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 405/800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:11.572577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:11.574759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:11.581860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.582288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.582725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.583408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.583856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.584276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.613303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-13c902a3-2204-475a-886e-9a61e38c4e96 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Sep 13 19:55:11.613871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 396/801] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:11.834048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:11.836183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:11.842558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.843035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.843469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.844148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.844595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.845015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.877995 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-33178863-3bf3-4824-8dba-5cb39930b340 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Sep 13 19:55:11.879132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 406/802] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:11 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:12.106338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:12.106930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:12.113368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.113875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.114309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.114984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.115432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.115851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.123763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:12.124370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:12.130392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.130900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.131447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.132138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.132584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.133028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.211928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:12.219825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-34209d2d-32f1-4d23-945c-5e6d397d5409 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100386 Sep 13 19:55:12.220399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 407/803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:12.270437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:12.278052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d6f66c69-fabb-4c83-87c5-8588f9fe942f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.175584 Sep 13 19:55:12.278643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 397/804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:12.625803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:12.627960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:12.633869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.634343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.634772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.635440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.635889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.636298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.664952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ee8d9ec0-ba6d-4483-8d10-7d05e457f439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Sep 13 19:55:12.665484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 408/805] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:12.891519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:12.893617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:12.899689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.900164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.900593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.901269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.901742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.902162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.931505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-80d70599-8014-44f8-865e-db068acbf972 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Sep 13 19:55:12.932050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 398/806] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:12 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:13.242916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:13.243450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:13.250434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.250913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.251345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.252022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.252467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.252886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.301753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:13.302364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:13.308566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.309047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.309483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.310204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.310653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.311075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.327228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:13.328438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:13.336410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c99b9379-3de6-41ad-83ac-d88fafcd2706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097467 Sep 13 19:55:13.336976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 409/807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:13.443465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:13.451329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b089c7da-09db-4b17-a8c7-0eb2142bd268 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154150 Sep 13 19:55:13.452143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 399/808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:13.677845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:13.680033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:13.685983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.687051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.687485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.688166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.688644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.689064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.717420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3ef9ff89-7ff2-415e-98dc-d7e963494d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Sep 13 19:55:13.718000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 410/809] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:13.944121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:13.946197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:13.952195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.952678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.953107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.953823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.954266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.954682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.983847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-971a8726-c3f7-4891-9dd2-0f7456197d9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Sep 13 19:55:13.984383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 400/810] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:13 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:14.360218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.360775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:14.367161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.367628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.368053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.368723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.369164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.369577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.430896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:14.438515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6b9ec206-a687-42bd-963e-b62f230788b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082801 Sep 13 19:55:14.439084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 411/811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:14.477337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.478009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:14.484576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.485063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.485499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.486287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.486784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.487207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.618114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:14.625984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-216f4883-a49d-450d-9679-c9df1514b1fd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152475 Sep 13 19:55:14.626588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 401/812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:14.728888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.731095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:14.737107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.737581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.738040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.738718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.739167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.739585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.769982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-45823dec-bfcf-4f2e-bde3-fa3bfc328f91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Sep 13 19:55:14.770535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 412/813] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:14.995494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.997538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:15.004739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.005215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.005670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.006348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.006790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.007202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.036815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eb1ca138-bc0f-4186-af1e-e32796bd6011 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Sep 13 19:55:15.037370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 402/814] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:14 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:15.460784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:15.461446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:15.468136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.468617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.469545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.470242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.470685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.471101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.532223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:15.540219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3d4bd850-85e1-4869-9544-38bdb866e8ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083271 Sep 13 19:55:15.540771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 413/815] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:15.650678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:15.651283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:15.657802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.658279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.658771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.659446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.659897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.660316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.782706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:15.784971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:15.788814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:15.790963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.791716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.792653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.792895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.793330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.793803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.796849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2be6d86b-a66f-4ae2-98db-108b92c78902 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150041 Sep 13 19:55:15.797422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 403/816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:15.823338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-917ef79d-8eea-46fa-82f5-608fa220af08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Sep 13 19:55:15.823894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 414/817] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:16.049374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:16.051616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:16.057864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.058345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.058984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.059481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.059928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.060377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.089834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cbf6a648-a4ad-4ed6-93eb-f45900b21d6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Sep 13 19:55:16.090393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 404/818] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:16 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:16.563915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:16.564528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:16.571171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.571649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.572074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.572809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.573372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.573825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.646145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:16.653779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1df2c023-d6f4-4721-bec5-e360d53df9fd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093712 Sep 13 19:55:16.654280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 415/819] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:16.819103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:16.819697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:16.825807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.826286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.826717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.827396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.827847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.828804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.835637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:16.837806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:16.843551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.845312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.845312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.845824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.846268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.846681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.872318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:16.879045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1614e9a5-b325-4fc0-87e2-ff4ce8db63ba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Sep 13 19:55:16.883829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 416/820] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:16.966298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:16.974533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7000003d-cb7a-4459-8fd9-d4fa55f2649e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.159250 Sep 13 19:55:16.975099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 405/821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:17.102452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:17.104587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:17.111267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.111742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.112177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.112854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.113304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.113758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.142187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ab73ee40-01da-470f-a387-845c48f75b6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Sep 13 19:55:17.142720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 417/822] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:17 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:17.677955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:17.678593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:17.684488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.684961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.685394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.686111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.686556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.686972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.748815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:17.756899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-03e0b664-8915-4dd4-98ac-b6cfccc44fb7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082733 Sep 13 19:55:17.757627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 406/823] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:17.891425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:17.893957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:17.901366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.901825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.902262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.902947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.903396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.903815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.934691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63147ed4-55f2-43df-92a4-921885022c30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Sep 13 19:55:17.935245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 418/824] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:17.997059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:17.997688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:18.004023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.004495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.004921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.005597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.006131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.006548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.149018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:18.154742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:18.157385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:18.158053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7bec8acb-dc26-4200-99c2-ce36cc15423a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.164778 Sep 13 19:55:18.158627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 407/825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:18.172074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.172562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.173001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.173731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.174188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.174620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.210854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b3591461-02e3-4b4b-af12-9cec371736b1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059956 Sep 13 19:55:18.211430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 419/826] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:18 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:18.780223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:18.780823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:18.787803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.788287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.788719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.789412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.789890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.790309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.864106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:18.873782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e093e6ac-b260-495d-a0d6-5a737798f4a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097518 Sep 13 19:55:18.874354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 408/827] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:18.949635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:18.957500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:18.964172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.964871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.965310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.966041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.966577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.967056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.016947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7810e06e-68c5-4954-884f-b5cf921b69d5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070203 Sep 13 19:55:19.016947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 420/828] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:19.181882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:19.182780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:19.192118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.192955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.193760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.194903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.195664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.196379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.226131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:19.228271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:19.234205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.234692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.235110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.235793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.236241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.236656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.270203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-191e2efd-312f-4cd5-bb4a-4d996364a0d7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048147 Sep 13 19:55:19.270795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 421/829] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:19 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:19.369600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:19.380338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6efbda2a-6292-405b-8966-6f97be442507 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.202394 Sep 13 19:55:19.380924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 409/830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:19.899180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:19.899786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:19.905886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.906958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.907390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.908119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.908547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.908966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.983378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:19.993517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d58b1d0b-0f7c-49f7-9101-923fee147636 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098222 Sep 13 19:55:19.994122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 422/831] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:20.028159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:20.030343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:20.036352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.036826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.037265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.038024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.038488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.038909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.067916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a095942-281a-4c88-8344-d06e7ca23980 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Sep 13 19:55:20.068462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 410/832] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:20.283129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:20.285190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:20.291346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.291819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.292244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.292917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.293354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.293806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.323045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2be68a78-abcf-4fc1-ba4f-3bf767990117 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Sep 13 19:55:20.323580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 423/833] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:20 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:20.404074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:20.404686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:20.411002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.411479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.411914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.412595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.413050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.413495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.542687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:20.551017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7be88ac0-4142-4a2d-806c-fb797a70d4da tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150782 Sep 13 19:55:20.551689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 411/834] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:21.024163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.024776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.031857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.032335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.032765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.033453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.033926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.034365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.080590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.083056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.089575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.090095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.090535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.091233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.091769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.092199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.100189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:21.107885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-028e3841-96d2-406e-b57e-0691da7f8469 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087517 Sep 13 19:55:21.108594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 424/835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:21.124168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f339880e-1982-4064-83cd-a2e1c0b478e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Sep 13 19:55:21.124648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 412/836] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:21.335249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.337401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.343357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.344444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.344882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.345569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.346041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.346467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.375591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-67f52e19-ca1f-4ec9-8365-c9171dae8d52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Sep 13 19:55:21.376076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 425/837] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:21.574704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.575329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.582826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.584308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.584786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.585494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.585972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.586398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.740720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:21.748653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bcc754b8-dec9-4807-96ef-c421ea3adcaa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.177791 Sep 13 19:55:21.749245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 413/838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:22.124001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-4cf083b3-cbc8-444f-86c7-7a2dc066f4ab req-8d4651f6-637b-4020-9372-00ff89a95675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11000afd-6551-4b16-81dd-f5905971fb0f", "name": "network-vif-unplugged", "status": "completed", "tag": "1fcd70a1-2198-49dc-8b96-511dac023c32"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:22.132051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:22.132665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:22.134630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-4cf083b3-cbc8-444f-86c7-7a2dc066f4ab req-8d4651f6-637b-4020-9372-00ff89a95675 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.135111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-4cf083b3-cbc8-444f-86c7-7a2dc066f4ab req-8d4651f6-637b-4020-9372-00ff89a95675 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.135527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-4cf083b3-cbc8-444f-86c7-7a2dc066f4ab req-8d4651f6-637b-4020-9372-00ff89a95675 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.139924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.140939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.141378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.142272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.142721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.143349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.149012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-4cf083b3-cbc8-444f-86c7-7a2dc066f4ab req-8d4651f6-637b-4020-9372-00ff89a95675 service nova] Creating event network-vif-unplugged:1fcd70a1-2198-49dc-8b96-511dac023c32 for instance 11000afd-6551-4b16-81dd-f5905971fb0f on hv-cinder-82880 Sep 13 19:55:22.154074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-4cf083b3-cbc8-444f-86c7-7a2dc066f4ab req-8d4651f6-637b-4020-9372-00ff89a95675 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099708 Sep 13 19:55:22.154672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 426/839] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:22.160735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:22.163005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:22.164947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:22.170489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.170966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.171401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.172123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.172708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.173134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.206514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-17e0826c-0830-4ba6-bf83-c49bccb8cd31 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050473 Sep 13 19:55:22.206985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 427/840] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:22.212076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:22.221664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b8f2a3c4-d41f-41cb-9d28-1dfaaede4971 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093028 Sep 13 19:55:22.222254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 414/841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:22.387760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:22.390099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:22.397161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.397842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.398293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.398982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.399427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.399844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.430642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f50363d2-a934-4780-9067-2b611dc1f089 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046859 Sep 13 19:55:22.431214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 428/842] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:22 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:22.776136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:22.776732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:22.785223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.785815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.786460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.787666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.788153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.788584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.929164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:22.937727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-62ca84dd-15f7-4dca-9371-2e4b6bbc125f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165993 Sep 13 19:55:22.938434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 415/843] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:23.220426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:23.223252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:23.233104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.233599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.234100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.235052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.235398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.236017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.244753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:23.245394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:23.252660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.253147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.253799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.254672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.255283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.256028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.259461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:23.283510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cd79a5ee-5f8f-491b-a93b-9a789b9866c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068385 Sep 13 19:55:23.284153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 429/844] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:23.344934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:23.362684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bfe98a30-4d92-4ad1-8c0c-90c49274a6e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120812 Sep 13 19:55:23.365812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 416/845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:23.445715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:23.448242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:23.454780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.455263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.455695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.457756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.458493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.458941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.489717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fca53036-41e2-4524-90b8-057cbb96c1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Sep 13 19:55:23.490279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 430/846] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:23 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:23.961540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:23.962192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:23.969069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.969964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.970733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.971894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.972821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.973324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.104337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.114939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5118ecee-65c5-4da0-b7ae-1ffe545d7bf7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157207 Sep 13 19:55:24.115513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 417/847] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:24.297180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:24.299271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:24.305828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.306320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.306759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.307447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.307903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.308330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.337561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2a6e5a86-173c-436b-a63f-9bdafb584965 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Sep 13 19:55:24.338126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 431/848] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:24.389979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:24.390636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:24.396551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.397030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.397470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.398204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.398652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.399074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.461698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.469850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-00ecdb94-3ba0-43d2-a545-5ff0e0039b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083627 Sep 13 19:55:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 418/849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:24.502011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:24.504167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:24.510049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.510538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.511075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.511759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.512208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.512633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.541980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c763aa77-7b03-47e0-b268-4f4a7abae150 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Sep 13 19:55:24.542520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 432/850] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:24 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:25.138626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.139228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.146155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.146636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.147227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.147831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.148278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.148698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.279330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:25.286978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f79c7205-7813-4540-8e0a-763a4b476ef5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152183 Sep 13 19:55:25.287540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 419/851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:25.350679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.352938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.359761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.360269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.360700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.361374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.361841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.362258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.391327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-68988df6-dc44-4179-9ef1-47f7cb2b5c22 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Sep 13 19:55:25.392483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 433/852] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:25.492956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.493558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.499461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.499930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.500357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.501595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.502056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.502471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.554642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.556847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.561918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:25.563160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.564319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.564813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.565497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.565969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.566386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.570041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-022d9936-a1d1-4cdb-a0fa-98a0e77a370c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.080874 Sep 13 19:55:25.570387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:25.574069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 420/853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:25.598730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b85ccb65-dcf2-4df6-b911-5c7fa96215dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 Sep 13 19:55:25.599287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 434/854] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:26.309438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:26.310035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:26.316948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.317415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.317875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.318542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.318993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.319404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.404563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:26.406781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:26.413686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.414167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.414603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.415296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.415996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.416421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.458523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bb1dba4b-7840-4fc2-8f34-370f084a6afc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057912 Sep 13 19:55:26.459120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 435/855] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:26.460678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:26.469721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e4a285a6-dc2d-47eb-af8c-2d251dbbab03 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.164079 Sep 13 19:55:26.470308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 421/856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:26.594372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:26.594931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:26.601572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.602092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.603366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.604315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.604983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.605847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.613477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:26.617217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:26.625708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.626790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.627250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.627956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.628408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.628841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.665330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-28cbabf9-8d2c-452e-a4c6-7c361f596f6e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058374 Sep 13 19:55:26.666276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 422/857] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:26 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:26.683473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:26.692017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5a0d4d8a-e8da-4605-b38d-c74fea7ec7a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101861 Sep 13 19:55:26.692588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 436/858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:27.471291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:27.473473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:27.479973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.480453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.480887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.481573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.482050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.482472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.498051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:27.498645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:27.505546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.506061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.506496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.507192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.507641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.508067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.513152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-44b66678-8cc7-4d07-948c-03dc1b06d9de tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Sep 13 19:55:27.513759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 423/859] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:27.639053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:27.647333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6b24346e-d9b4-4415-a3e8-089b902d7db4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153016 Sep 13 19:55:27.647897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 437/860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:27.677501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:27.679693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:27.686216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.686705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.687152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.687853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.688890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.689316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.714738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:27.715485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:27.721414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cd4c0287-5b60-4c7e-9312-b29e71f9bff7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Sep 13 19:55:27.721801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.722294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 424/861] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:27 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:27.722434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.722705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.723393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.723838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.724255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.786656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:27.794805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9a338bd4-76bc-496b-b218-1461e44b57da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084028 Sep 13 19:55:27.795459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 438/862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:28.526590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.528740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.531044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=96 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:28.537982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.538462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.538899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.539575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.540017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.540435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.570493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a480afd8-06a4-4247-b1b1-ebff09bff9eb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047794 Sep 13 19:55:28.571048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 425/863] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:28.670307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.670892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.677475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.677999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.678427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.679112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.679558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.679982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.736269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.738477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.744456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.744931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.745374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.746082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.746551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.746942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.784892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-38c6b171-d26d-42b9-a9f6-f750681f9a2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053927 Sep 13 19:55:28.785435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 426/864] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:28.817927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.818764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.820615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:28.824563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.825044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.825475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.826196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.826673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.827094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.828450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9e0b20e7-8d64-4dff-a790-b72a2dd4bf61 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.161959 Sep 13 19:55:28.829016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 439/865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:28.889862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:28.897847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d68a932c-f11a-41bb-b046-db2dd47cbcd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083898 Sep 13 19:55:28.898430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 427/866] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:29.583898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.586187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.592151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.592634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.593074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.593793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.594250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.594674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.624006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-69d9da51-4daf-4978-96ad-058c579361d8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Sep 13 19:55:29.624555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 440/867] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:29.797477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.799715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.806137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.806614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.807049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.807732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.808177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.808592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.838940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9fd55e7e-42df-463b-9df3-b13a733ab12d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Sep 13 19:55:29.839426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 428/868] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:29.852030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.852657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.859133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.859602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.860026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.860729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.861170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.861585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.920563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.921327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.927267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.927821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.928325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.929014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.929462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.929905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.997361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:30.006450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9580765a-9c66-468c-be52-044ee788e5f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089712 Sep 13 19:55:30.007316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 429/869] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:30.018050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:30.026979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a2401833-c585-4c0f-a40b-6323ca0c4400 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.178794 Sep 13 19:55:30.027569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 441/870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:30.637022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:30.639219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:30.645308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.645847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.646287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.646975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.647427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.647855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.678221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d27afb37-9664-4534-a68e-64605b8b4518 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045134 Sep 13 19:55:30.678789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 430/871] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:30.852115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:30.854313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:30.860694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.861178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.861622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.862321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.862771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.863197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.894235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71cae282-aaf3-45b9-b7d8-fb1f70728b15 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 Sep 13 19:55:30.894702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 442/872] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:30 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:31.030100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.030705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.037574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.038079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.038509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.039181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.039625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.040043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.049818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.050417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.056234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.056702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.057127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.057821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.058267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.058680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.112700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:31.120423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6d8a0534-8cd0-4fec-9e02-872971c8d704 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094091 Sep 13 19:55:31.121005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 431/873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:31.203738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:31.211860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a23f3b77-4b56-434c-b3e6-36b7377c6ed6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165727 Sep 13 19:55:31.212421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 443/874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:31.691451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.693571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.699568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.700043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.700470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.701144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.701588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.702027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.726286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:31.731262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-67bf9633-84e0-49f4-bbb5-02055dd2de4f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Sep 13 19:55:31.731812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 432/875] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:31.906651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.908733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.915096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.915831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.916268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.916937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.917376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.917822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.947240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b599a4ec-91ab-4799-8774-908a13bbeea9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Sep 13 19:55:31.947776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 444/876] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:32.143414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.144017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.151670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.152144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.152575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.153247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.153717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.154133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.214987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:32.223199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-281c554c-f4e9-4837-8cc2-db3e0d592825 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083622 Sep 13 19:55:32.223763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 433/877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:32.235425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.236604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.242785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.243266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.243702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.244384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.244832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.245266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.377810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:32.385499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-28694981-d32e-4759-bc95-22fcbe0ac648 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153966 Sep 13 19:55:32.386108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 445/878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:32.743998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.746164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.751975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.752451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.752881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.753551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.754017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.754434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.930350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b1b52e36-0aa6-409e-aa87-f5aabb18abb9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190193 Sep 13 19:55:32.930897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 434/879] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:32.959580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.961788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.968165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.968708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.969147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.970390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.970850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.971274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.000715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0fc3c349-67a6-4a4e-8aea-8cd15a5100ae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Sep 13 19:55:33.001200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 446/880] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:32 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:33.246341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:33.247131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:33.253845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.254256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.254682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.255349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.255790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.256204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.316713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:33.324523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7e0ba18a-5fa6-40b6-961c-90472cdcea93 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082091 Sep 13 19:55:33.325066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 435/881] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:33.409379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:33.410023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:33.416316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.416797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.417234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.417977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.418428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.418853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.551818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:33.559876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1371d110-295d-4235-9d93-9987a468072f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154886 Sep 13 19:55:33.560493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 447/882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:33.943021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:33.945265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:33.951284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.951767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.952199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.952920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.953370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.953815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.985128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-482bdc8d-c8a7-4e0a-b9af-245b95189ee2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Sep 13 19:55:33.985711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 436/883] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:34.013264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:34.015443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:34.022578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.023055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.023487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.024171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.024613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.025028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.058128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cfac03a8-0267-4d5a-b8d4-f5a70f110b52 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048744 Sep 13 19:55:34.058691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 448/884] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:34 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:34.449194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:34.449832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:34.456405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.456871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.457294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.458000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.458438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.458848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.523701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:34.531648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8464b08e-993a-40a1-89fb-cd2b1ee97271 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.187737 Sep 13 19:55:34.532237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 437/885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:34.583662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:34.584266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:34.590458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.590935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.591369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.592051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.592500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.592946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.725795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:34.736256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b846d9a1-fd7c-4a96-a055-d1dfe727d975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156436 Sep 13 19:55:34.736845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 449/886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:34.997956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:35.000146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:35.006061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.006470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.006893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.007560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.007998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.008411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.037586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-229d1ea8-3ca1-4fce-86e0-abd83832be10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Sep 13 19:55:35.038149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 438/887] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:35.070663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:35.072807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:35.079150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.079636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.080075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.080754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.081198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.081641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.107358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:35.113208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a5fc301d-558b-437f-aee7-7bbbfa08ea43 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046530 Sep 13 19:55:35.113796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 450/888] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:35 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:35.554677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:35.555391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:35.561967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.562448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.562884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.563600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.564048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.564468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.636145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:35.645074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0ca8f43b-7fff-423f-a2db-43c9d1246ecd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094281 Sep 13 19:55:35.645667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 439/889] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:35.764195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:35.765250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:35.776242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.781760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.781760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.781760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.781760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.782436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.968562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:35.976505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7be9f112-d819-451b-8959-1d5c83bce739 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.219953 Sep 13 19:55:35.977077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 451/890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:36.050788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:36.052913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:36.059073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.059556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.059989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.060678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.061125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.061545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.098465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1591698d-d084-4ae6-a8e5-234f560f2f49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052043 Sep 13 19:55:36.099039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 440/891] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:36.126595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:36.128857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:36.135735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.136228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.136666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.137368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.137853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.138277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.169489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5a919a75-2fbf-4f7d-aaf3-8d9719f89556 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047543 Sep 13 19:55:36.170155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 452/892] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:36 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:36.670693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:36.671303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:36.678677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.679159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.679614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.680287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.680734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.681151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.755216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:36.765746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e3b5f04-d5b2-4bdc-8614-81ad8776882c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098443 Sep 13 19:55:36.766786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 441/893] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:37.000161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:37.000773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:37.007537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.008019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.008445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.009136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.009582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.010039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.113106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:37.115355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:37.122611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.123396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.124172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.124970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.125416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.125954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.159169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:37.165959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b561f99c-ce59-4a43-af08-dbf35a367bff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058645 Sep 13 19:55:37.166538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 442/894] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:37.167928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-20e948fa-612a-453d-a1b5-484eda194028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.171792 Sep 13 19:55:37.168498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 453/895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:37.183230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:37.185508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:37.192333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.192814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.196811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.198024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.198492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.198965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.230523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-62b3c7e4-b9f0-49d6-a000-e9a0c30c2c8e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051216 Sep 13 19:55:37.231106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 443/896] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:37 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:37.791359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:37.792000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:37.798574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.799053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.799483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.800164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.800616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.801041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.866984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:37.874726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f0804c86-0c3e-4f02-a9bd-12a7e36ce722 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087539 Sep 13 19:55:37.875291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 454/897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:38.178342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.180461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:38.186908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.187396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.187836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.188550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.189003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.189430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.191209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.191819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:38.198248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.198732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.199164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.199852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.200327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.200745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.219242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-875d11c5-51c4-4d74-86cb-d5f12139bc42 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Sep 13 19:55:38.220445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 444/898] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:38.243363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.245515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:38.251670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.252146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.252573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.253266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.253725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.254145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.287718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f6392b56-570d-49e3-80c3-3b48132b9f1b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047919 Sep 13 19:55:38.288631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 445/899] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:38 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:38.342600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:38.351403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ee17786d-a578-4864-bfde-2d7f6ce2f5d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.163900 Sep 13 19:55:38.351988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 455/900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:38.899172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.899790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:38.906379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.906864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.907308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.908028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.908481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.908904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.985944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:38.995623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-64266141-9466-4924-bc0b-fc1e93be5946 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100915 Sep 13 19:55:38.996260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 446/901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:39.232879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:39.234988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:39.241897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.242389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.243005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.243893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.244353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.244776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.287871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4585cfb-e0d2-450d-98c0-91ed37e83ef5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059330 Sep 13 19:55:39.288733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 456/902] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:39.302393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:39.305232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:39.314036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.314520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.314955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.315646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.316086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.316502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.351893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e99778e2-5956-490f-9fe6-a1d81cef3889 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053584 Sep 13 19:55:39.352512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 447/903] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:39 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:39.381203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:39.382140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:39.392743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.393246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.393717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.394425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.394912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.395333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.537794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:39.547282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4c34c8a5-1923-4c0f-815c-0450ecf2c714 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.173373 Sep 13 19:55:39.547854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 457/904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:40.024069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:40.025232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:40.033211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.033723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.034164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.034875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.035328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.035754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.104985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:40.114933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e07031c-8a36-4287-b4b9-d3bccc1b4ccf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098644 Sep 13 19:55:40.115908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 448/905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:40.303641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:40.305977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:40.313743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.314302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.314779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.316507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.316507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.317183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.358483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ea57929-133c-47f5-b8e3-d59008f257d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058894 Sep 13 19:55:40.359099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 458/906] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:40.366329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:40.368612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:40.376144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.376622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.377053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.377776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.378220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.378637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.395499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:40.414242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-68dee08b-c2cc-4f26-a3a2-1e57e6157f83 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052407 Sep 13 19:55:40.414811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 449/907] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:40 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:40.571599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:40.572135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:40.578670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.579165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.579603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.580313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.580766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.581239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.724389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:40.732395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7e38fd72-186a-4247-84cc-97a840675c1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165365 Sep 13 19:55:40.732971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 459/908] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:41.145385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:41.146010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:41.153220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.154771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.154771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.155185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.155614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.156415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.235478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:41.247722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e2b7471a-8494-4b54-b660-c72339be808b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106431 Sep 13 19:55:41.248787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 450/909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:41.373406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:41.376512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:41.384058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.384682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.385212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.386128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.386695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.387229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.426258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4263a349-27b2-478e-b275-0a68c39422e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056823 Sep 13 19:55:41.427064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 460/910] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:41.428753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:41.431627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:41.439815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.440308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.440742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.441835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.442619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.443357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.479172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9afaf0ac-ea91-4aa9-9835-faf8fafd3262 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054722 Sep 13 19:55:41.479746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 451/911] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:41 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:41.757651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:41.758261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:41.764510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.764985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.765412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.766126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.766640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.767076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.902702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:41.910666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-90af0c1e-294f-4454-9b5f-b8efd5d25f3d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157307 Sep 13 19:55:41.911242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 461/912] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:42.277065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:42.277598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:42.284166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.284648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.285089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.285814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.286273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.286696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.349116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:42.358432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cfa16de6-cce9-4a4c-81ff-413ec2634f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085175 Sep 13 19:55:42.359115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 452/913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:42.440365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:42.442683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:42.449087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.449558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.450011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.450688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.451127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.451541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.485929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a8c88bec-ccaf-404d-aedc-882fdd8192e5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049926 Sep 13 19:55:42.486513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 462/914] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:42.491634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:42.493867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:42.500273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.501296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.501762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.502441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.502887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.503308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.532393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-65002116-d524-4c77-b542-62ad6898d374 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Sep 13 19:55:42.532872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 453/915] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:42 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:42.934066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:42.934666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:42.941077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.941549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.942002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.942671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.943116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.943531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.073290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:43.081165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c88ab0d8-2ed6-4135-b8c7-5d2510f31e53 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150921 Sep 13 19:55:43.081759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 463/916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:43.384790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:43.385425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:43.392110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.392584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.393018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.393726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.394178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.394603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.458489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:43.466291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4a088306-03b6-4651-8e46-7f78780b83bb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085359 Sep 13 19:55:43.466843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 454/917] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:43.498085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:43.500230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:43.506573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.507045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.507474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.508147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.508590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.509009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.537843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a42aa4ee-1da1-4d86-9cba-67987b7bf16f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Sep 13 19:55:43.538381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 464/918] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:43.544845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:43.547056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:43.553881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.554362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.554790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.555465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.555907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.556325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.584656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-da4a2005-14a0-4ed0-9cad-5f66cbea3545 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Sep 13 19:55:43.585265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 455/919] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:44.104133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:44.104745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:44.111958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.112425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.112848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.113516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.113995 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.114402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.248118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:44.255715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8488b0fe-f5c2-4266-ab0e-29ac5d1b49ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155491 Sep 13 19:55:44.256280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 465/920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:44.489401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:44.490222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:44.496261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.496746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.497177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.497908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.498355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.498774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.551835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:44.555533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:44.562585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.563072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.563813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.564180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.564623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.565039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.565614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:44.573450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c7ac062b-aca9-45f5-8758-911080b6f5ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087879 Sep 13 19:55:44.574059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 456/921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:44.597186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8e6b1440-9b10-40d6-9938-01a773ca80cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050503 Sep 13 19:55:44.597454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:44.599595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:44.602555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 466/922] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:44.608355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.608920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.609354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.610707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.610707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.612704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.642932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b916adf9-d1df-4ea5-8b4b-f8070481f651 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050340 Sep 13 19:55:44.643480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 457/923] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:45.279121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:45.279675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:45.285627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.286122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.286555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.287233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.287679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.288098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.303673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:45.418304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:45.426566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-53c959ab-7307-4a9a-b2af-13665abbe8c2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151384 Sep 13 19:55:45.427137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 467/924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:45.596556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:45.597093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:45.603536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.604020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.604456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.605177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.605643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.606064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.610814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:45.613068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:45.619668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.620159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.620591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.621283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.622398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.622398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.657332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0cd5bad3-469f-49e7-b07a-aabdcc7cd83d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050725 Sep 13 19:55:45.661940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 468/925] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:45.668039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:45.671050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:45.678419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.678597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:45.678914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.679346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.680039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.680652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.681077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.693300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d8da5b48-5016-4b88-bd32-f0a9bdb44eb2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100817 Sep 13 19:55:45.694267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 458/926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:45.714169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2aca41c1-c8cd-495c-a267-30e105cca42a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051026 Sep 13 19:55:45.714746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 469/927] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:46.449719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:46.450325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:46.456902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.457382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.457866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.458556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.459000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.459419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.594159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:46.602498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-81032a05-b346-403e-8f30-31df9396daf3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156715 Sep 13 19:55:46.603166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 459/928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:46.673434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:46.675606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:46.682039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.682509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.682932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.683610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.684054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.684467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.715729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5e8c57b5-dc1d-4725-9bda-12babf01d831 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Sep 13 19:55:46.716214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 470/929] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:46.716390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:46.716997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:46.724904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.725512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.726097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.726884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.727192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:46.727543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.728137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.729488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:46.736391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.736869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.737292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.738016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.738458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.738871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.772782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-74efae7f-c82e-47a0-bb05-40761a45c94e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Sep 13 19:55:46.773360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 471/930] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:46 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:46.801860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:46.809791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b787164c-e672-48d3-a1a6-735a0fc1efce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097302 Sep 13 19:55:46.810376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 460/931] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:47.640661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:47.641265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:47.647637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.648122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.648556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.649258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.649749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.650173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.728160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:47.730502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:47.737875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.738365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.738804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.739511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.739958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.740383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.771878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7e857bed-ab6d-47c7-a232-8ef7974298dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Sep 13 19:55:47.772455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 461/932] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:47.785548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:47.787698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:47.787823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:47.794451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.795210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.795942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.796329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-83897c7e-269f-476e-bd93-8a59340f3047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.159672 Sep 13 19:55:47.796835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.796953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 472/933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:47.798210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.798638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.833316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-587853e0-869f-403f-b3a2-67c24060e782 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052677 Sep 13 19:55:47.834022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 462/934] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:47 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:47.837842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:47.838465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:47.846033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.846526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.846956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.847650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.848091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.848506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.913599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:47.921687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2f8a3979-b22b-46cc-8c77-df0a7bde922a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091781 Sep 13 19:55:47.922838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 473/935] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:48.784592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.786768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.793541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.794058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.794497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.795190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.795637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.796061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.820869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.821649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.827979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-330ef80b-7225-481e-b362-c4c2f66996cb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047369 Sep 13 19:55:48.828612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 463/936] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:48.828831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.829318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.829780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.830478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.830931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.831351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.847865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.850083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.856064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.856549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.856983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.857729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.858178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.858599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.890153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d151eb16-668c-4edc-b5d9-1bbe2a5c25bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046126 Sep 13 19:55:48.891024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 464/937] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:48.944822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.945436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.951490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.951977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.952417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.953183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.953730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.954273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.964196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:48.972413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8113d5ed-2eaa-47a1-83dd-89fdd13246e8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155838 Sep 13 19:55:48.972993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 474/938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:49.020233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:49.030513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0bea4de3-6550-4db0-9969-3f82067e599f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089182 Sep 13 19:55:49.031552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 465/939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:49.841007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:49.843255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:49.849818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:49.850299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:49.850727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:49.851418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:49.851862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:49.852283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:49.885891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-70166371-e7fd-4ca1-87eb-59a5fbad2252 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048924 Sep 13 19:55:49.886483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 475/940] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:49.901999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:49.904205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:49.910826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:49.911317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:49.911757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:49.912452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:49.912901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:49.913321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:49.916410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:49.947152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3f2a02e0-4944-4d56-b635-4a65205852ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049218 Sep 13 19:55:49.948665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 466/941] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:49.998999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:50.000093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:50.010562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.011391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.012122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.013294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.014120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.014831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.056369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:50.057339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:50.065108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.065758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.066271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.067103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.067615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.068098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.142946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:50.150959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-132e78b4-221c-4b8a-92ca-5d4b40f79806 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098387 Sep 13 19:55:50.151797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 467/942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:50.184108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:50.192874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a507fe57-2db3-42ba-90e0-aa1f841da5f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.200304 Sep 13 19:55:50.193688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 476/943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:50.898920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:50.901086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:50.908165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.909172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.909172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.909838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.910295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.910720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.945263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dd702551-99fd-44f3-beb4-da630695f87d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050280 Sep 13 19:55:50.945880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 468/944] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:50.962497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:50.964637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:50.966513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:50.972104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.972595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.973027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.973749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.974197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.974613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.007462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3c5f8821-6e5c-45b0-b9ec-1e44029ed8e9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049632 Sep 13 19:55:51.008098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 477/945] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:51.175688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:51.176212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:51.182782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.183266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.183701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.184392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.184842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.185261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.216169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:51.216777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:51.223087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.223568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.223999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.224718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.225164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.225582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.261276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:51.269886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7bb5b319-29fb-4b13-8da6-6b93c258b787 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098597 Sep 13 19:55:51.270536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 469/946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:51.366029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:51.374500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-88f9f74c-0cce-46ea-b10a-db9c9be40c84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.162069 Sep 13 19:55:51.375496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 478/947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:51.959887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:51.962228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:51.970597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.971178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.971684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.972429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.973022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.973532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.009128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7bfe0755-0867-430c-89c2-4e193fe9e4e0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053866 Sep 13 19:55:52.009911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 470/948] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:52.021741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:52.025574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:52.033245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.033754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.034193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.034885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.035330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.035748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.070718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f7dc9f48-e6c5-4a87-b144-63cc8e9e817b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053899 Sep 13 19:55:52.071432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 479/949] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:52.293133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:52.293783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:52.301000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.301489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.301954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.302649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.303097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.303518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.398056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:52.401719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:52.402645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:52.409230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3da675ef-42c1-4572-b80c-5d92c03b7f04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120118 Sep 13 19:55:52.410041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.410251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 471/950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:52.410443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.410874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.411658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.412106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.412522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.578640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:52.591092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a780b726-2ead-4f73-81e6-dae4dcd6ad91 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.194632 Sep 13 19:55:52.591697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 480/951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:53.024263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:53.026499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:53.037080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.037802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.038307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.039043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.039696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.040435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.084363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e118b616-dd7c-40e1-a8fc-c4999e25d82c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063678 Sep 13 19:55:53.085376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 472/952] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:53.086846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:53.089147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:53.096925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.097407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.097871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.098611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.099059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.099551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.135785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-52110e5f-e86c-47a3-8647-086c51986f29 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054777 Sep 13 19:55:53.136359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 481/953] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:53.444473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:53.445081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:53.453544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.454365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.455949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.456204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.457464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.457716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.534178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:53.542916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-40c136f8-0c20-4a85-ad88-94f6b1d1a73f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102237 Sep 13 19:55:53.543511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 473/954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:53.616167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:53.616776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:53.623057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.623550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.623987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.624699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.625191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.625631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.784951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:53.798557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0f7468b-a082-4e2f-ba2b-a10e578744b3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.186010 Sep 13 19:55:53.799182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 482/955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:54.099541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:54.102998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:54.115761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.116614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.117397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.118444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.119268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.120041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.149956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:54.152718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:54.158262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-970c4ae9-4bd8-446f-8881-b05839b316aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062307 Sep 13 19:55:54.159278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 474/956] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:54.162000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.162677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.163281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.164248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.164792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.165759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.199794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-80f0e2cb-5784-4f22-a933-4577719e6b30 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054104 Sep 13 19:55:54.201160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 483/957] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:54 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:54.567732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:54.568510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:54.570587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:54.576389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.576876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.577309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.578615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.579066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.579496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.667633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:54.681852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f2b4c5f7-3b03-4c1d-925c-56ea30da04a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117731 Sep 13 19:55:54.682873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 475/958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:54.826196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:54.826964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:54.835091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.835626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.836056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.836750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.838084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.838493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.841344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:55.008423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:55.023203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7706e8ec-616a-48f8-a443-70b8b0c7c719 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.203712 Sep 13 19:55:55.024261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 484/959] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:55.175936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:55.179271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:55.189944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:55.190684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:55.191335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:55.192451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:55.193193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:55.193959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:55.215450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:55.218768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:55.230025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:55.230681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:55.231226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:55.232041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:55.232595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:55.233122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:55.254197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fff94099-8146-4c70-bbba-2bc5f6c109ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082851 Sep 13 19:55:55.255265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 476/960] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:55.277814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-adfb5c5c-b488-446d-8940-9fe63b776a69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067803 Sep 13 19:55:55.278402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 485/961] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:55.720683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:55.721178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:55.730594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:55.731437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:55.732174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:55.733698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:55.734628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:55.735430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:55.820782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:55.829647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c5ceadf2-3f2d-45a2-878f-b033923b7bf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113784 Sep 13 19:55:55.830298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 477/962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:56.066536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:56.067492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:56.077518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.078954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.079746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.080625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.081087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.081521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.243641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:56.260780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71d6e9ff-a498-4fd2-9b52-266b32b7d575 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.201080 Sep 13 19:55:56.261616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 486/963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:56.281678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:56.285146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:56.291223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:56.293390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:56.296205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.297566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.298381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.299494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.300272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.300474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.300953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.301128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.301382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.302115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.302558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.302994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.336582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fdbf33d5-c0fe-413d-98d7-c23fec18a033 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049572 Sep 13 19:55:56.337164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 487/964] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:56 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:56.357197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dcfcc73f-4df7-4318-93aa-24017d9cef92 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083385 Sep 13 19:55:56.358276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 478/965] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:56.857681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:56.858761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:56.869302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.870156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.870898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.872109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:56.872810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:56.873495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:56.984826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:56.993226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-77276931-858d-485c-9b1d-651347494d5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.142613 Sep 13 19:55:56.993934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 488/966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:57.290481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:57.291359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:57.302324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:57.303077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:57.303611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:57.304847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:57.305691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:57.306246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:57.353059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:57.356982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:57.367364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:57.367998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:57.368684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:57.369587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:57.370450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:57.371173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:57.409379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2a520bb9-9393-4fd0-96b4-25e67ee17f9b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063319 Sep 13 19:55:57.410269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 489/967] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:57 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:57.416634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:57.419166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:57.429259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:57.430048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:57.430573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:57.431461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:57.431975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:57.432483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:57.467816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-93012705-f2d8-4138-91e9-4af53cd61f2e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056149 Sep 13 19:55:57.469018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 490/968] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:57.748603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:57.756985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f6612717-53dc-4446-9723-157d96859f32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.471529 Sep 13 19:55:57.757666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 479/969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:58.032293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:58.032970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:58.039505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.040258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.040723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.041423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.041914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.042338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.109645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:58.117860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c8d26720-6483-4628-bcd1-1dcced3d321d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090321 Sep 13 19:55:58.118557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 491/970] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:58.425373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:58.430056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:58.439961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.440774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.441543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.442734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.443531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.444256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.481940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:58.484823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:58.491360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0538c5ae-279e-4b84-a161-d315f93d317d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070648 Sep 13 19:55:58.491600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.491970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 480/971] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:58 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:58.492172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.492403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.493098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.493540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.493990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.548227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6515283b-7048-43f3-9474-85946bcb160f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069951 Sep 13 19:55:58.549036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 492/972] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:58.781324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:58.781871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:58.790205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.790714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.792712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.793476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:58.793968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:58.794399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:58.963862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:58.972829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2f847b06-c11a-46e3-a42e-3abb598bf85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.195498 Sep 13 19:55:58.973402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 481/973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:59.145788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:59.146937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:59.157982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:59.158900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:59.159697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:59.160959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:59.161836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:59.162626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:59.273297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:59.282938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-afbf186c-2682-4ee9-8527-0c250c761356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.144456 Sep 13 19:55:59.283584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 493/974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:59.510674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:59.514603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:59.524918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:59.525457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:59.525978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:59.526868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:59.527378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:59.527819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:59.567051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:59.568709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:59.571063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:59.579419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e36be7e-165b-4a69-9f24-6fd9d7a35621 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075827 Sep 13 19:55:59.580454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 482/975] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:59 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:59.582387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:59.583219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:59.583993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:59.585192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:59.586502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:59.587229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:59.640375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9b9c0cbb-05cf-40f4-904f-5c183ac3f7c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080363 Sep 13 19:55:59.641347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 494/976] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:00.000591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:00.001716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:00.011537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.012248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.013129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.014521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.015293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.022097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.183052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:00.193244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-222491ed-c7f1-4890-bf49-ad8ffe90345a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.199165 Sep 13 19:56:00.194020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 483/977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:00.309115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:00.310081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:00.317421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.317991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.318559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.319308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.319753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.320257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.388965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:00.397686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-06c31d43-0892-46ed-bd90-d5a5a00b1c65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094339 Sep 13 19:56:00.398277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 495/978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:00.592898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:00.595070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:00.601826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.602319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.602753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.603452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.603899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.604326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.637640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-928efe12-e240-4432-92ef-1bc869c12450 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048789 Sep 13 19:56:00.638224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 484/979] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:00 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:00.657114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:00.659388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:00.666242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.666735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.667173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.667888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:00.668343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:00.668796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:00.701448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6082867f-f3d4-4240-9aec-4ee79d13ba3f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Sep 13 19:56:00.702080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 496/980] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:01.223746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:01.224857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:01.235082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.235709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.237042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.238115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.238943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.239630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.395751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:01.403773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7eb1d95e-c344-4a38-ac01-7c1971c3ee90 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.187407 Sep 13 19:56:01.404347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 485/981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:01.420727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:01.421939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:01.428687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.429162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.429646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.430331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.430768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.431217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.493900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:01.502584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-51c5eba1-0426-492f-aaf0-1dcdff4160cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085650 Sep 13 19:56:01.503182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 497/982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:01.651182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:01.653342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:01.660476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.660961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.661396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.662125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.662577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.663003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.693350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-80ea225f-8604-41ce-86c5-ab25436a9741 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Sep 13 19:56:01.693958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 486/983] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:01 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:01.717559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:01.720533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:01.727145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.727644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.728114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.728819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:01.729278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:01.729726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:01.764338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c644be85-61e4-489a-bceb-b4b979c35d18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051002 Sep 13 19:56:01.765430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 498/984] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:02.430202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:02.430806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:02.441280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.441875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.442244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.442942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.443385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.443799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.527372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:02.528165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:02.535133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.535617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.536052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.536812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.537261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.537707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.620870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:02.625180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:02.629753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cc972f53-5498-489c-9326-1107a3df4153 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106172 Sep 13 19:56:02.630335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 499/985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:02.634295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d5018a4d-4732-4e6e-84f6-40ffb6d8f260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.208264 Sep 13 19:56:02.635308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 487/986] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:02.706245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:02.708407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:02.714701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.715183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.715645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.716331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.716774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.717194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.744990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:02.752170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-82ac4668-716e-4583-83b7-02d8c3e7ef38 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050132 Sep 13 19:56:02.752762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 500/987] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:02 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:02.777862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:02.780169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:02.787391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.787927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.788588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.789505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:02.790418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:02.790887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:02.825830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7fd8ded3-c047-47af-9196-aae94522ce65 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051855 Sep 13 19:56:02.826418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 488/988] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:03.652592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:03.653194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:03.659772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.660255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.660372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:03.660685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.660954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:03.661372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.661848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.662264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.667421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.667902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.668353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.669028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.669488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.669933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.735010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:03.748789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3142997c-c538-44a2-8aa7-4b5dab91ff4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099886 Sep 13 19:56:03.750298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 501/989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:03.771680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:03.771680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:03.774588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.774588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.774994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.775708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.776158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.776583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.810298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-37118a6a-b037-4dfb-a5ec-f0fb7f72f27f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049450 Sep 13 19:56:03.810879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 502/990] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:03 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:03.840422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:03.842729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:03.849786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:03.858284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c5fabdf8-7ec7-4945-a0a7-eb32659486e7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.201732 Sep 13 19:56:03.859455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 489/991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:03.859610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.860110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.860553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.861271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:03.862109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:03.862351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:03.921817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6be1debe-efb9-447c-bca1-526cfba7bf54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084971 Sep 13 19:56:03.922417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 503/992] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:04.772540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:04.773141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:04.779159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.779640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.780070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.780766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.781424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.781875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.823609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:04.825854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:04.832359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.832841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.833273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.834102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.834555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.835128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.845531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:04.853813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4c7d38fd-de20-4cb6-8df1-83e8739af14e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085147 Sep 13 19:56:04.854425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 490/993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:04.866836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b0bb8376-ee8d-4fb2-814a-a375e2db06e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Sep 13 19:56:04.867329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 504/994] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:04 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:04.882257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:04.882898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:04.888821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.889296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.889752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.890432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.890881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.891301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.934594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:04.937473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:04.943906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.944392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.944823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.945517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:04.946002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:04.946427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:04.978486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e8cbbae7-f2ce-47f7-bf69-15262091a866 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047849 Sep 13 19:56:04.979374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 505/995] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:05.049326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:05.057296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-69d5ca08-6f4a-44cc-b1f4-b16053e4b75a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.178818 Sep 13 19:56:05.057871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 491/996] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:05.876563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:05.877161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:05.881118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:05.883508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:05.884126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:05.884611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:05.885041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:05.885760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:05.886279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:05.886811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:05.892132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:05.893016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:05.893833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:05.894547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:05.895000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:05.895480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:05.931981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ad4b1bdc-c7be-4f22-b469-cb63e087c07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054644 Sep 13 19:56:05.932490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 492/997] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:05 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:05.950384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:05.958522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9a65ada-dbbe-44dd-8736-fb49e054ceb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085854 Sep 13 19:56:05.959089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 506/998] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:05.990879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:05.993062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:05.999077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:05.999557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:05.999995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.000674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.001121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.001541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.031222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3300994a-05a9-446d-938c-267c143e384f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Sep 13 19:56:06.031778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 493/999] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:06.080618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:06.081220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:06.088390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.088871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.089535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.091367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.091908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.092527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.231459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:06.241345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1c304ce9-0c58-415d-a132-7ab1e68365bb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165410 Sep 13 19:56:06.241931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 507/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:06.944347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:06.946527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:06.952947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.953429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.953902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.954593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.955076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.955504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.981085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:06.981835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:06.985304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-974fdeef-b878-4995-a009-8692a35ee168 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Sep 13 19:56:06.985902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 494/1001] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:06 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:06.989054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.989543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.990004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:06.990729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:06.991181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:06.991602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:07.043754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:07.046487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:07.052517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:07.052914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:07.053401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:07.053875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:07.054565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:07.055008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:07.055424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:07.060469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-85bb0986-e568-48a5-a7d1-4090ddae3e23 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083405 Sep 13 19:56:07.061137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 508/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:07.085757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d238ae5e-6aac-42b0-bbdb-d1b823b42900 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Sep 13 19:56:07.086307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 495/1003] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:07.268693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:07.269248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:07.275308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:07.275784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:07.276210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:07.276917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:07.277358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:07.277801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:07.408029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:07.415971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-87c81d9d-1f37-46ce-85e5-37eabf9592fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153356 Sep 13 19:56:07.416529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 509/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:07.996905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:07.999088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:08.005513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.006027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.006468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.007155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.007607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.008031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.039156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-649a1350-e18f-4c77-92f7-fa300e21f0f0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Sep 13 19:56:08.039969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 496/1005] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:07 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:08.084139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:08.084747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:08.091396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.091875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.092303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.093679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.094147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.094549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.098412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:08.100567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:08.106295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.106783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.107223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.107924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.108478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.109418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.138464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8b0d17a5-1d5f-4b2f-af6f-27880d59f992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Sep 13 19:56:08.139036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 497/1006] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:08.158418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:08.166308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7f46d3a4-c402-4696-bc43-2afa26417505 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086004 Sep 13 19:56:08.166871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 510/1007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:08.439507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:08.440113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:08.446424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.446900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.447328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.448000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.448442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.448884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.587004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:08.595552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-82a33144-1ae3-4928-993a-c172298f6e27 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.159883 Sep 13 19:56:08.596115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 498/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:09.052202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:09.054440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:09.060389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.060865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.061317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.062701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.063146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.063569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.092490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-97aa976e-a03e-4315-9b12-46f6d37562a4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Sep 13 19:56:09.093744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 511/1009] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:09 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:09.150857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:09.152986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:09.159949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.160426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.160856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.161527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.161994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.162410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.176100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:09.188379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:09.189004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:09.194952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.195434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.195885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.196575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.197019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.197429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.197742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-45063bab-70a5-456a-bfa8-ae0ba471e779 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050722 Sep 13 19:56:09.198323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 499/1010] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:09.259728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:09.269318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b882af75-99c8-4ace-8db5-8644acd86692 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084768 Sep 13 19:56:09.270036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 512/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:09.619051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:09.619645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:09.625631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.626115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.626546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.627221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.627664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.628080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.763061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:09.770733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7ebde8f2-c36f-450d-859d-3c30f536bb5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155560 Sep 13 19:56:09.771293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 500/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:10.105717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:10.107863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:10.114749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.115231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.115663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.116343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.116795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.117217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.145984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-484e8d37-97ae-4dd0-bb26-2add67a7c53e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Sep 13 19:56:10.146527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 513/1013] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:10 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:10.210691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:10.212811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:10.219794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.220266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.220695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.221370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.221840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.222256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.251208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6d95a8f3-3429-46a7-90a0-f34be971bf9f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Sep 13 19:56:10.251753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 501/1014] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:10.295041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:10.295656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:10.302090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.302569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.303010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.303687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.304136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.304554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.364519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:10.372166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6ddd354d-a0e7-4992-9d1b-c05b0fa906f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.080986 Sep 13 19:56:10.372724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 514/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:10.794341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:10.794939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:10.800967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.801443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.801957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.802665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.803164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.803623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.933582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:10.941837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2c16f52a-9456-4984-9af8-051abebbcd56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151337 Sep 13 19:56:10.942396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 502/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:11.158941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.161113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:11.167764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.168241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.168676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.169345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.169816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.170234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.199179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e5bbddab-476a-47ad-a1f5-19dc8d8e56c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Sep 13 19:56:11.199742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 515/1017] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:11.263620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.265895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:11.272452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.272939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.273377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.274108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.274562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.274988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.305250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5e4d37f3-76c0-406d-ab29-fbef371a6852 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045670 Sep 13 19:56:11.305836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 503/1018] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:11.395645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.396290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:11.402246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.402731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.403171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.403858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.404313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.404741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.473783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:11.481507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2e6b5e78-fe22-4b16-b85a-c4661303bcb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089909 Sep 13 19:56:11.482091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 516/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:11.964288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.964888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:11.971062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.971539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.971963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.972650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.973078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.973492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.101906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:12.110690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fd1eed68-58e6-4452-abe2-b748f886fde8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150277 Sep 13 19:56:12.111347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 504/1020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:12.212479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.214780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:12.221108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.221583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.222045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.222748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.223192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.223611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.237711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:12.253887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-66f2bb5a-0cc3-4e69-898f-542365dec71b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Sep 13 19:56:12.254442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 517/1021] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:12 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:12.318098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.320295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:12.326597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.327073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.327503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.328174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.328621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.329037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.357541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-21ec69c4-0afe-4ffe-a6d3-07e1796a2590 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Sep 13 19:56:12.358602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 505/1022] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:12.504364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.504900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:12.510773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.511247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.511673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.512344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.512787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.513201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.573404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:12.580970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0c2e0ab9-110a-4988-b830-41c9eff8ab86 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.080528 Sep 13 19:56:12.581530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 518/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:13.134789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.136168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.141809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.142286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.142714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.143383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.143825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.144238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.266688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.268820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.275276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.275916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.276352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.277116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:13.277338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.277503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.277895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.285546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a1d7f155-dde1-4a83-b876-be7273282f77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154549 Sep 13 19:56:13.286135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 506/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:13.309642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9c3b1208-e30c-4b5b-a398-c79a8ead60a8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Sep 13 19:56:13.310195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 519/1025] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:13 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:13.369976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.372107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.378427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.379011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.379371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.380009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.380448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.380863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.410354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7b2c067c-4085-43b0-af43-294c311f83f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Sep 13 19:56:13.410904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 507/1026] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:13.604506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.605033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.611165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.611640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.612065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.612735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.613193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.613795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.675000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:13.683234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e1ae3744-412f-4c27-a416-8215cdcf4931 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082667 Sep 13 19:56:13.683797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 520/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:14.310140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:14.310674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:14.317025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.317511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.317983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.318680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.319201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.319629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.321798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:14.323997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:14.330680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.331166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.331601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.332626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.332764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.333155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.365126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4511477-3a2a-4090-982a-9253b626ada2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047083 Sep 13 19:56:14.365916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 521/1028] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:14 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:14.422806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:14.424952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:14.431054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.431535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.431968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.432658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.433097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.433512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.464668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1ffd3b7f-680b-470b-9cf3-4505b17637e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Sep 13 19:56:14.465436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 522/1029] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:14.467380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:14.475700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-29f0255e-9b65-4851-b63e-404a90f27c08 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.169571 Sep 13 19:56:14.476252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 508/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:14.707451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:14.708066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:14.713953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.714422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.714844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.715645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.716086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.716502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.781870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:14.793073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c03c3f9e-e947-4bbd-b85c-beb08743fa75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089378 Sep 13 19:56:14.793745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 523/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:15.378606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:15.380764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:15.387305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.387789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.388226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.388910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.389394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.389861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.419297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c5909a4a-5c61-4684-a477-17a8a23f9e5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Sep 13 19:56:15.419864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 509/1032] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:15 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:15.477381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:15.479538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:15.486435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.486906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.487332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.488657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.488657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.488883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.498674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:15.499282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:15.505540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.506057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.506494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.507185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.507629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.508054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.518891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c625cb34-1686-40a0-ac39-cb5f0f901a61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Sep 13 19:56:15.519460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 524/1033] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:15.640753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:15.648753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a8ecbb80-1e98-47db-b16c-c9d93371cc1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153854 Sep 13 19:56:15.649324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 510/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:15.816354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:15.816992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:15.822981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.823461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.823896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.824582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.825033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.825458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.885632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:15.893329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c850b502-cb62-469e-805a-17801f1c9759 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.080786 Sep 13 19:56:15.893943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 525/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:16.431665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:16.433857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:16.440903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.441384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.441846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.442570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.443016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.443434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.473146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2df41fa4-699e-454d-9eb1-4ba20d56cba3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Sep 13 19:56:16.473729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 511/1036] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:16 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:16.531344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:16.533581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:16.540465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.540966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.541419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.542153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.542623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.543045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.572969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0cce301f-3695-42b5-a30d-a4fc73989715 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Sep 13 19:56:16.573534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 526/1037] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:16.674206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:16.675184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:16.682650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.683069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.683527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.684209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.684651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.685095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.817751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:16.825341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4ceb5d6c-0596-4673-8006-d324c1aca4b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157786 Sep 13 19:56:16.825932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 512/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:16.915656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:16.916282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:16.918147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:16.923809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.924280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.924708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.925384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.925851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.926272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.993254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:17.000869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-126b759d-eb63-41fc-910c-c19c6a6bbded tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089277 Sep 13 19:56:17.001432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 527/1039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:17.485738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:17.487931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:17.493922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.494410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.494849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.495538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.495987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.496418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.526027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-80d46152-542a-4323-bdbe-d456a4ef46d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Sep 13 19:56:17.526578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 513/1040] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:17 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:17.585356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:17.587538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:17.594880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.595362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.595801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.596536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.596956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.597376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.628195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f96b665-9e18-4e7a-a66c-ab19aa6fb7b7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046828 Sep 13 19:56:17.628772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 528/1041] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:17.848733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:17.849338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:17.855715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.856195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.856632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.857307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.857899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.859024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.986341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:17.994010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-176ddb08-41e0-41f7-bf4d-6c438861d01d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.149051 Sep 13 19:56:17.994573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 514/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:18.023193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:18.023803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:18.029912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.030391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.030820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.031502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.031950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.032424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.096551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:18.104450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3fe0eb44-f8c2-4f0b-a571-6d6ed53dd752 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085114 Sep 13 19:56:18.105014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 529/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:18.539620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:18.541786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:18.548380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.548860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.549294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.550006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.550452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.550873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.579244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a4d112f5-97fe-48a4-9f81-a39c0cd46323 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Sep 13 19:56:18.579788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 515/1044] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:18 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:18.640923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:18.643161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:18.649174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.649672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.650107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.650780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.651225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.651639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.681274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b78d173b-69ba-4bb0-ad14-1e830b61cdba tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Sep 13 19:56:18.682027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 530/1045] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:19.018124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:19.018738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:19.025514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.026030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.026465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.027205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.027650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.028072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.031205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:19.128077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:19.128816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:19.135639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.136223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.136726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.137482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.138021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.138580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.165549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:19.173965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-08bf4482-ceb9-46ad-9ad1-464d60ba834f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.160348 Sep 13 19:56:19.174542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 516/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:19.199602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:19.207264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1efe7c92-4748-4d6f-a12a-1bfb1eaa344e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083698 Sep 13 19:56:19.207812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 531/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:19.591183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:19.593886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:19.600900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.601383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.601852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.602543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.603026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.603473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.632959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0c59b2e4-af17-4239-a8b2-31d7704c2a66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Sep 13 19:56:19.633507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 517/1048] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:19 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:19.694109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:19.696300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:19.703208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.703682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.704113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.704793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.705240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.705682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.734935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a165b03a-a28e-4631-baa9-8ba208a505a4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Sep 13 19:56:19.735456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 532/1049] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:20.197792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:20.198403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:20.204816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.205295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.205768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.206447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.206896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.207321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.230147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:20.230678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:20.237093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.237571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.238042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.238725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.239172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.239592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.327518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:20.335623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1fb2037d-9fff-4a27-addd-5ca3421aa9f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109533 Sep 13 19:56:20.336199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 533/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:20.366362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:20.375306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-05aa4614-d35e-4a91-8fa3-981b33663f21 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.181466 Sep 13 19:56:20.376663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 518/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:20.646601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:20.648787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:20.655257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.655742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.656171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.656852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.657417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.657924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.660646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:20.691184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6576ef48-ac4a-4efb-b9e4-ec33c5db3a1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049171 Sep 13 19:56:20.691749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 534/1052] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:20 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:20.748773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:20.750958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:20.756976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.757455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.757928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.758615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.759063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.759483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.790910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d9ffa268-3b28-448b-9ea1-2a74d118bb61 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046646 Sep 13 19:56:20.791476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 519/1053] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:21.360662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:21.361421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:21.368589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.369064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.369493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.370194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.370646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.371061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.399652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:21.400260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:21.406810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.407294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.408314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.409012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.409644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.410082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.432636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:21.441338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f8430e4c-2718-4dad-9b04-9bbe2f1179e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086455 Sep 13 19:56:21.441969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 535/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:21.551056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:21.559006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d6b07917-327d-4842-8ff0-02dca1af65ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.163226 Sep 13 19:56:21.559584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 520/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:21.703444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:21.705586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:21.712047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.712524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.713088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.713793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.714238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.714660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.749478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-17a234c3-daac-42ff-8189-7f1d2fd23434 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050072 Sep 13 19:56:21.750050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 536/1056] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:21 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:21.803419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:21.805555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:21.811430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.811905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.812333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.813005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:21.813448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:21.813885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.843122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a2a68b81-1daf-4607-bb7d-519125ed9f18 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Sep 13 19:56:21.843800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 521/1057] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:22.463779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:22.464399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:22.470921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.471408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.471864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.472652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.473068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.473493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.536125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:22.544011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eb8159d9-f46c-477e-b125-38929a802e06 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084216 Sep 13 19:56:22.544571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 537/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:22.581938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:22.582550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:22.588907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.589387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.589859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.590574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.591024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.591443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.721793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:22.729414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e182968-864e-4e6c-87f2-50399cc84d39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151319 Sep 13 19:56:22.730009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 522/1059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:22.765854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:22.768006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:22.774299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.774805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.775240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.775944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.776411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.776833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.807108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2ba6d74e-e455-45a8-a231-5d5206e1e620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Sep 13 19:56:22.807661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 538/1060] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:22 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:22.856570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:22.859273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:22.865221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.865725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.866163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.866838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.867278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.867691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.896693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5cb32f44-b222-4c02-b6e5-4fb5218964d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Sep 13 19:56:22.897231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 523/1061] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:23.573221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:23.574354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:23.582636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.583281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.583727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.584430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.584885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.585310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.646900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:23.654991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-396c7a35-2de3-4c34-ba87-be6828a80721 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087842 Sep 13 19:56:23.655636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 539/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:23.753329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:23.754023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:23.760622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.761099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.761534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.762245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.762696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.763121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.819097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:23.821257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:23.828141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.828556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.828985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.829764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.830211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.830626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.859804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2209879b-fa10-4d1d-b48c-a1621e8cf635 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Sep 13 19:56:23.860366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 540/1063] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:23 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:23.896554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:23.904587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-49784897-fdfb-4e9e-af4c-b0d1ac042fc9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155112 Sep 13 19:56:23.905178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 524/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:23.908406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:23.910627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:23.916728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.917201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.917643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.918323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.918769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.919186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.947894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4cad43cd-ba32-4508-bb01-776fad8fb1ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Sep 13 19:56:23.948426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 541/1065] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:24.679028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.679629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:24.681496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:24.687182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.687665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.688097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.688781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.689227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.689674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.751126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:24.760317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c20d2438-1a4f-49d5-b25f-462b48760fff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085108 Sep 13 19:56:24.761047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 525/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:24.872489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.874660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:24.881620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.882114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.882547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.883228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.883674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.884093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.920406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-267ba053-8805-458c-84d4-9b2f24bd39d5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051874 Sep 13 19:56:24.920961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 542/1067] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:24.927813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.928451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:24.934422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.934843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.935280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.935967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.936416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.936841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.960398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.962560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:24.969065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.969550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.970008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.970694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.971142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.971564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:25.000966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f0e72532-8e23-47c3-9333-c17555e4c1f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Sep 13 19:56:25.001736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 543/1068] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:25.069569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:25.077982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d8d7202f-7815-4ac9-8274-485240d17e25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154005 Sep 13 19:56:25.078551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 526/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:25.782595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:25.783190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:25.789157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:25.789916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:25.790341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:25.791008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:25.791449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:25.791860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:25.852039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:25.860151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-323e520a-0a41-485d-98ae-b413b1038dbd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081384 Sep 13 19:56:25.860733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 544/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:25.932619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:25.934917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:25.941380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:25.941906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:25.942340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:25.943018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:25.943461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:25.943880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:25.973345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c57009a2-415f-416d-ab9a-6f85285c13b2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Sep 13 19:56:25.973826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 527/1071] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:26.012972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:26.015157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:26.022039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.022523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.022954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.023640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.024084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.024502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.054454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-53b46ede-429d-4591-aba9-724ed9ca7fbb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Sep 13 19:56:26.054997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 545/1072] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:26.102082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:26.102711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:26.110843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.111346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.111777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.112748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.113198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.113628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.243315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:26.251142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-55bda2fe-c3da-49da-8ea0-073f373e9245 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152927 Sep 13 19:56:26.251707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 528/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:26.883103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:26.883704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:26.890264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.890736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.891165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.891834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.892276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.892693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.967772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:26.975537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-229cb1f1-9a78-47de-8d3f-614387e6a4e9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096312 Sep 13 19:56:26.976085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 546/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:26.985563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:26.987768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:26.994197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.994682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.995118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.995831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.996281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.996702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.027676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b3978386-3c4f-4684-ae3c-f5cf74b26f13 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Sep 13 19:56:27.028222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 529/1075] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:26 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:27.067134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:27.069334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:27.075700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.076177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.076610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.077292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.077766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.078192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.106614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cf7cfbc0-e539-4a7c-90d7-83889ce9e9a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Sep 13 19:56:27.107164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 547/1076] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:27.274192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:27.274842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:27.280634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.281101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.281528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.282226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.282667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.283087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.416451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:27.424800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2b4c8b1e-fc2e-4c47-aea8-36ecb8eb1323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154446 Sep 13 19:56:27.425290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 530/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:27.998049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:27.998579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:28.004515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.004990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.005420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.006124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.006566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.006985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.041939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:28.044084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:28.050698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.051182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.051619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.052316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.052762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.053182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.067897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:28.076184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-28dbc2f3-e34f-4623-90f8-4a790e92da9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082142 Sep 13 19:56:28.077297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 548/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:28.083716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3fd11165-5070-4197-b19f-24b167ff1682 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045953 Sep 13 19:56:28.084266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 531/1079] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:28 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:28.119355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:28.121625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:28.127466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.128045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.128479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.129159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.129625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.130054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.160073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e081bb4b-9bdd-483c-83d9-ff0c2a43f281 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Sep 13 19:56:28.160623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 549/1080] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:28.448083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:28.448623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:28.455365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.455848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.456305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.456992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.457439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.457893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.590208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:28.592450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:28.599297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4e04b6cb-6978-42ae-8640-69230caebcb1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155165 Sep 13 19:56:28.599865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 532/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:29.096968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:29.098892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:29.099309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:29.099490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:29.105539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.106049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.106184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.106477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.106618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.107050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.107166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.107580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.108426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.108647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.108874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.109291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.136010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:29.142253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8e4903c5-ae7b-4a6a-a916-b038e6dbc13a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050090 Sep 13 19:56:29.146973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 550/1082] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:29 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:29.171392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:29.173008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:29.175253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:29.179344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eb0f3c61-1867-4cb9-aea7-7f308b1017fe tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084282 Sep 13 19:56:29.179924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 533/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:29.181066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.181535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.182011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.182709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.183159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.183584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.212476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eefb2f62-81bc-4df9-a1e1-f13c85d37093 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Sep 13 19:56:29.213031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 551/1084] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:29.623229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:29.623852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:29.630068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.630544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.630988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.631662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:29.632099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:29.632516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.767580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:29.775456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a9522b0f-7c6b-4172-8ffc-e8eca0cac923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156143 Sep 13 19:56:29.776030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 534/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:30.154285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:30.156431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:30.162918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.163397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.163829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.164773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.165217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.165657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.196336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-06bc9514-08d1-4b1a-b8ed-700d5c0c6077 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Sep 13 19:56:30.196911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 552/1086] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:30 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:30.201465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:30.202139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:30.208682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.209169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.209623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.210328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.210777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.211202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.224524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:30.226756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:30.233026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.234070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.234511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.235207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.235661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.236082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.268837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-92d5a4b7-ca45-4e09-a3d8-b9edf18d155f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048187 Sep 13 19:56:30.269422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 553/1087] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:30.280738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:30.288656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cbfc3a59-8d27-4967-8050-079723eb8ca5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091132 Sep 13 19:56:30.289520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 535/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:30.798918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:30.799524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:30.805676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.806167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.806597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.807873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.807873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.808127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.942053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:30.949914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3543dcb3-3a78-4702-9c73-29e5abc7bdf4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154821 Sep 13 19:56:30.950489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 554/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:31.209484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:31.211661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:31.218285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.218773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.219211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.219908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.220359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.220785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.254829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d987bffc-5a58-4253-b4fe-9b6822c59232 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049287 Sep 13 19:56:31.255396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 536/1090] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:31 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:31.280367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:31.282574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:31.289719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.290211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.290639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.291332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.291785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.292209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.313053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:31.313706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:31.320258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.320841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.321284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.322113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.322562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.322983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.326890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-83d2b8de-7605-4a2b-9ac7-27f54602ee10 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050412 Sep 13 19:56:31.328463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 555/1091] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:31.393081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:31.400996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-421288a3-5456-45aa-a1d9-aafd1727e530 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092422 Sep 13 19:56:31.401566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 537/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:31.975972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:31.976686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:31.984993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.985642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.986198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.987001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.987454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.987881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.119957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:32.127603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c3cfcebe-4036-48f1-a8b6-bea7a8317dfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156810 Sep 13 19:56:32.128196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 556/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:32.267837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:32.270160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:32.276551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.277034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.277467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.278192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.278641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.279061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.309381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a0ff03f1-266d-475a-b00d-ef3e3871a7c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Sep 13 19:56:32.309972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 538/1094] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:32 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:32.339890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:32.342127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:32.349097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.349574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.350038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.350717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.351159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.351573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.380951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d57634b4-6a3a-41f0-9e1e-b8c6db39291f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Sep 13 19:56:32.381501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 557/1095] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:32.425696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:32.426297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:32.432274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.432746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.433191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.433880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.434322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.434734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.500773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:32.508511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4071e0be-15bb-461e-ae65-ee7d817251c0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086740 Sep 13 19:56:32.509067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 539/1096] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:33.151010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:33.151624 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:33.158266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.158754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.159436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.160357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.160820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.161243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.292155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:33.300207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2f108b5d-ef3d-4070-84e7-4456ef9c7878 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152811 Sep 13 19:56:33.300751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 558/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:33.321394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:33.323591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:33.330545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.331316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.331477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.332165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.332614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.333039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.364983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-58e646bb-c588-406f-9e5f-4fd04968f044 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047435 Sep 13 19:56:33.365555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 540/1098] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:33 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:33.394153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:33.396413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:33.402790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.403266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.403704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.404388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.404836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.405253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.435487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-539628f9-f7a9-4dae-b75a-964c21dd73ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Sep 13 19:56:33.436044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 559/1099] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:33.530868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:33.531473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:33.537451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.537954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.538385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.539316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.539803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.540168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.601188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:33.608825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5c9b0e99-235a-4b56-bc34-2beddf75abf2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081835 Sep 13 19:56:33.609385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 541/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:34.323413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:34.324013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:34.330150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.330626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.331134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.331842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.332291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.332712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.377412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:34.379743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:34.386391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.386872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.387307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.387997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.388443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.388864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.419680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b56d4192-43d7-4955-a279-38053f6b568f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Sep 13 19:56:34.420258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 542/1101] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:34 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:34.448831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:34.451005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:34.456857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.457339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.457797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.458481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.458923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.459334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.469006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:34.476817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f5baf011-1410-425d-9bb4-87010321a352 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157427 Sep 13 19:56:34.477586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 560/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:34.494635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7a5f6920-9168-404d-a89f-45d9f891a02e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049849 Sep 13 19:56:34.495186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 543/1103] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:34.631238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:34.631856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:34.637797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.638274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.638705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.639388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.640359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.640804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.703942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:34.711710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0889e194-7210-45bd-a6d2-78886ce51e07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084491 Sep 13 19:56:34.712259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 561/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:35.432527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:35.434699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:35.441667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.442152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.442588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.443270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.443719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.444139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.474696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-14fedb9d-5521-497e-a390-6942655be378 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045767 Sep 13 19:56:35.475094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 544/1105] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:35 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:35.506450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:35.507052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:35.507684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:35.509859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:35.514241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.514719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.515194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.515873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.516004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.516353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.516479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.516785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.516906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.517522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.517995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.518418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.549026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3324d2a9-40d6-4ffd-9b9a-efcf53027978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Sep 13 19:56:35.549591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 545/1106] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:35 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:35.647997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:35.656333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c2747f12-5115-4ce2-84f4-5d3cba2d6892 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153763 Sep 13 19:56:35.656899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 562/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:35.735046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:35.735647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:35.741565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.742094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.742523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.743203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.743643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.744061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.804309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:35.812063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-65bad4d4-7b8c-43ba-8983-aca6ddc8b4ad tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081508 Sep 13 19:56:35.812629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 546/1108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:36.487430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:36.489573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:36.495776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.496325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.496802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.497534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.498046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.498501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.528294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e3711874-9dd6-42ee-b0ae-bee0b35c0a56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Sep 13 19:56:36.528980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 563/1109] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:36 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:36.561484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:36.563718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:36.570141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.570614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.571045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.571717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.572156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.572568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.602145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-73e8d12a-988d-4c0f-aa92-f0e9abc0518f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Sep 13 19:56:36.602716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 547/1110] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:36.680014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:36.680612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:36.686449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.687412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.687836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.688507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.688947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.689384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.821392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:36.829486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-22105d54-790f-45da-874d-020a6e2d3ff2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153232 Sep 13 19:56:36.830082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 564/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:36.834455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:36.835064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:36.840935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.841412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.841887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.842563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.843008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.843427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.904161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:36.911810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3872f942-3635-401d-991e-d2072c999369 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081351 Sep 13 19:56:36.912372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 548/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:37.541829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:37.543963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:37.550413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.550882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.551307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.551978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.552417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.552829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.582858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-43c29b65-88af-4f87-86eb-bee19a99db5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Sep 13 19:56:37.583404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 565/1113] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:37 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:37.615312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:37.617634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:37.625330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.625877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.626660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.627901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.628716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.629197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.645453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:37.670685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fad19835-5991-4422-a08d-31facd382bde tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059703 Sep 13 19:56:37.675112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 549/1114] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:37.853199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:37.853746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:37.859772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.860242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.860669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.861339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.861804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.862219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.935404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:37.936002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:37.942480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.942956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.943381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.944058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.944499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.944913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.024515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:38.026421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:38.032327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8826cdf4-3f80-46a1-8a9e-544e9bfb55a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.183640 Sep 13 19:56:38.032896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 566/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:38.034465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de255d0a-257c-4edd-a10c-c8e8d2b04aba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102839 Sep 13 19:56:38.035022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 550/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:38.595110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:38.597312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:38.603731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.604205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.604635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.605316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.605793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.606217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.620289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:38.636726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a976ed1b-3f84-4cc3-9211-a37d8eca4db8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Sep 13 19:56:38.637289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 567/1117] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:38 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:38.686992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:38.689164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:38.696368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.696841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.697275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.697985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.698428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.698845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.728806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7d6db068-6268-41e7-b759-ea0bc3702b1f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045853 Sep 13 19:56:38.729351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 551/1118] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:39.055706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:39.056338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.056463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:39.056988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.062262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.062737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.062859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.063163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.063339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.063776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.063911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.064268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.064483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.064685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.064958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.065636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.155152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:39.163481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-46187b74-8901-4532-a504-d18cb8988042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110866 Sep 13 19:56:39.164301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 552/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:39.219138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:39.227069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cd72289c-f042-4961-924b-ce5537505b6c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.175134 Sep 13 19:56:39.227639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 568/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:39.648594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:39.650767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.656632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.657116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.657563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.658277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.658733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.659151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.688501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b6f783b0-78b3-42ce-a2ab-1dc853761c3f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Sep 13 19:56:39.689122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 553/1121] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:39 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:39.740655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:39.742861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.749972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.750452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.750887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.751569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.752007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.752434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.784990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f2f57423-7b79-46bc-b789-b50e19a291d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 Sep 13 19:56:39.785562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 569/1122] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:40.186409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:40.187021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:40.193451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.193962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.194392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.195074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.195535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.195954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.249350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:40.249980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:40.256074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.256553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.256978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.257699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.258027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:40.258160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.258547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.265904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dce601e2-dfd8-40dd-8cd7-927881245d5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083286 Sep 13 19:56:40.266563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 554/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:40.390486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:40.398180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3a11424d-6c9c-4b3d-81ee-45d5bc120fc0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152867 Sep 13 19:56:40.398750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 570/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:40.701235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:40.703423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:40.709448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.710246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.710681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.711511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.711956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.712368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.741971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1914b8e0-2a75-4a00-9c97-59096c72e2fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Sep 13 19:56:40.742532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 555/1125] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:40 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:40.798201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:40.800496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:40.807098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.807578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.808016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.808710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.809159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.809578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.840852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b15e507b-0d3b-40fa-a6ff-4bdc0cf713db tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046846 Sep 13 19:56:40.841411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 571/1126] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:41.291187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:41.291710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:41.298987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.299460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.300007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.300794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.301221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.301708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.369241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:41.377908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-41dfce43-28dd-4d25-9eee-de4e8f7c18bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091412 Sep 13 19:56:41.378498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 556/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:41.426421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:41.427022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:41.433021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.433499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.433959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.434635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.435082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.435502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.573538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:41.581525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-94fed73d-9dc8-4a40-a74d-314a55cac528 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.158957 Sep 13 19:56:41.582132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 572/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:41.755400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:41.757695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:41.764349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.764842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.765287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.766030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.766481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.766907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.808829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bd9ce9a3-e9ba-423d-ac6e-f45e00a44758 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057991 Sep 13 19:56:41.809403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 557/1129] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:41 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:41.854316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:41.856408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:41.863077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.863565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.864000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.864698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:41.865148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:41.865570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.895758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7fd5939c-e606-4e27-9613-0d58f0b80caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Sep 13 19:56:41.896318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 573/1130] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:42.401353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.401990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.410057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.410546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.410986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.411696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.412141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.412562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.481844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:42.490514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e912b4e-f964-4ae6-a50e-9fed827609d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093221 Sep 13 19:56:42.491087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 558/1131] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:42.605018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.605628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.612476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.613291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.613834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.614595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.615041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.615458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.751244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:42.759584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0d8febf6-f054-49f8-9bfc-e89b4f16e0e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.158050 Sep 13 19:56:42.760170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 574/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:42.822845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.825001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.831756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.832238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.832669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.833360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.833844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.834267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.864506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-91430be4-2859-46b3-be46-2230b2f6ae2d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Sep 13 19:56:42.865062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 559/1133] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:42.908321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.910505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.917170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.917677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.918122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.918813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.919264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.919688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.948656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-af148f04-feb2-4ff9-ae7e-f73c28f5f9f4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Sep 13 19:56:42.949136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 575/1134] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:43.515118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:43.515723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:43.522031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.522500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.522927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.523627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.524070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.524492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.586086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:43.593782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0a66996d-25f5-45fd-b0d6-297999d0aff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083173 Sep 13 19:56:43.594337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 560/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:43.783996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:43.784607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:43.790857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.791332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.791759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.792442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.792887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.793304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.877544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:43.879842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:43.885888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.886372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.886804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.887489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.887933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.888349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.919623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de7c423e-942d-437b-87c7-f214843ccb85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046578 Sep 13 19:56:43.920197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 561/1136] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:43.940134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:43.947946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d92c2b0c-aa41-4ea4-8fa4-b698f03ea723 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.168113 Sep 13 19:56:43.948520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 576/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:43.960876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:43.963126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:43.969680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.970166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.970614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.971309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.971757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.972181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.002444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-303d2b83-2d05-49eb-9333-0bf068951f6c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045562 Sep 13 19:56:44.003002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 562/1138] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:44.616692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:44.617302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:44.619230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:44.625214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.625720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.626162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.626849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.627306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.627727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.693633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:44.701464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2eff6a4b-6862-478c-811a-638b13330546 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088651 Sep 13 19:56:44.702105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 577/1139] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:44.932676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:44.934777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:44.941241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.941749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.942189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.942867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.943309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.943730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.971570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:44.972172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:44.973004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4994a5e8-2683-438f-8046-5fb85c48f08b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Sep 13 19:56:44.973564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 563/1140] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:44.978341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.978820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.979253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.979938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.980388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.980807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.015653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:45.018204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:45.024805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.025290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.025760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.026461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.026907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.027326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.057311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c6141fc2-e0f0-4c79-a1dd-c7119a7ba562 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046389 Sep 13 19:56:45.061670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 564/1141] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:45.110061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:45.117764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e11c16b3-0cf6-4dda-909f-2be522081dae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150517 Sep 13 19:56:45.118333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 578/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:45.724813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:45.725439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:45.731468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.731942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.732374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.733053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.733527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.734589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.798803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:45.806514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6458a03d-fa48-47f0-9864-731f3d056c84 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085571 Sep 13 19:56:45.807071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 565/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:45.985926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:45.987993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:45.994397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.994874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.995306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.995984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.996424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.996846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.028555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-01aef69f-9602-44c6-9261-3bc999073c4f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046924 Sep 13 19:56:46.029121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 579/1144] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:46.069508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:46.071729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:46.078767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:46.079248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:46.079684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.080373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:46.080822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:46.081241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.083804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:46.115697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-47f3d414-a15e-4a87-81db-6a37f4ec0c7e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050108 Sep 13 19:56:46.116282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 566/1145] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:46.140884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:46.141500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:46.147684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:46.148171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:46.148605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.149303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:46.149794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:46.150217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.288101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:46.296451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f2ea5f12-70a1-4520-b713-e62e800f3649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.159973 Sep 13 19:56:46.297036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 580/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:46.829656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:46.830525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:46.836876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:46.837355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:46.837893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.838586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:46.839030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:46.839453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.906678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:46.914818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b5c00fa2-4194-4db7-94d2-1d0fe0a38556 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089069 Sep 13 19:56:46.915386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 567/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:47.044879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:47.047125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:47.053422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.053951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.054393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.055091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.055535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.055957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.086795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8875452e-5a30-42f3-8c42-47b17bb49c5e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Sep 13 19:56:47.087283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 581/1148] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:47 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:47.128955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:47.131340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:47.137437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.137959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.138389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.139083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.139523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.140520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.169953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-31e3bbd7-5e09-4abd-86f7-6c52edabf800 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Sep 13 19:56:47.170510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 568/1149] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:47.320403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:47.321015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:47.327007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.327991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.328429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.329111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.329563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.330010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.463109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:47.471438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c3be5dbf-e76d-4565-922b-3fdb5fc6476d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154953 Sep 13 19:56:47.472005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 582/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:47.938261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:47.938868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:47.945547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.946128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.946588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.947303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.947760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.948220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.015690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:48.032804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-09f72544-c7f9-45f6-927e-79c585ca62f0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098832 Sep 13 19:56:48.033293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 569/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:48.099870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:48.102187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:48.109422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.109930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.110362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.111056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.111499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.111915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.145045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-70453f0c-f4d6-4296-8c5d-17ede256b72d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049165 Sep 13 19:56:48.145628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 583/1152] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:48.183883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:48.187321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:48.193536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.194048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.194472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.195166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.195607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.196021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.227510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-09a13f30-7bd0-45af-acf4-6329635710b1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048351 Sep 13 19:56:48.228068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 570/1153] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:48.494481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:48.495078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:48.501167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.501694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.502205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.503179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.503660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.504080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.506871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:48.638422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:48.646102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-88b32c44-0c2e-4ab8-a40f-5283147f1174 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155417 Sep 13 19:56:48.646662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 584/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:49.056384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:49.057018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:49.063582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.064060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.064497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.065486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.065870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.066293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.130355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:49.138324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b236f5d1-763b-444c-b73d-64c6857d1902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085748 Sep 13 19:56:49.139002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 571/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:49.159221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:49.161409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:49.173086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.173576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.174054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.174753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.175195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.175614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.206603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4bbec18f-7ec7-4692-b83f-e0aa1e776164 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051736 Sep 13 19:56:49.207178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 585/1156] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:49.241009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:49.243306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:49.249951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.250468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.250903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.251594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.252044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.252462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.282522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c2eb0a10-822f-467b-b4b4-127cab81cdf8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Sep 13 19:56:49.282980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 572/1157] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:49.670109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:49.671287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:49.678058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.678573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.679259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.679960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.680410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.680821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.820528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:49.828419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ae4e9b98-18f9-4732-9810-019e80355560 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.162183 Sep 13 19:56:49.828994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 586/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:50.161892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:50.162499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:50.169116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.169590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.170068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.170732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.171750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.172166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.220314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:50.222507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:50.228417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.228902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.229336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.230454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.230557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.230968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.233162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:50.241550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b7ddf4a9-0baa-4006-a92b-8b179cd2eee1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083620 Sep 13 19:56:50.246557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 573/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:50.262417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f9565fc-45f6-4923-a34f-305ef97501c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Sep 13 19:56:50.262978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 587/1160] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:50.294898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:50.297153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:50.303139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.303655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.304063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.304755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.305210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.305657 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.334897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-db19f375-607b-49b6-b57d-88e87260de53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Sep 13 19:56:50.335451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 574/1161] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:50.852187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:50.852802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:50.859883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.860370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.860798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.861504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.861991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.862442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.009131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:51.017387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5a513cd6-3f7c-46c3-bb5b-adf15b764cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.169071 Sep 13 19:56:51.018007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 588/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:51.264296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:51.264913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:51.267483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:51.273054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:51.273544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:51.274121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.274718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:51.275168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:51.275600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.276125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:51.278571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:51.285313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:51.286091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:51.286569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.287303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:51.287809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:51.288370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.322317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2cb9b239-542a-4d88-9729-833f364ab9a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051144 Sep 13 19:56:51.322924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 589/1163] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:51 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:51.345983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:51.347344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:51.349560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:51.355650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:51.356116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:51.356365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4a64c07f-e5e4-4ba2-9c62-cc9e42a44bd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096254 Sep 13 19:56:51.356552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.356940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 575/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:51.357278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:51.357820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:51.358770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.389508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a7345066-c45c-4e06-a4d4-db1b60a93e16 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Sep 13 19:56:51.390104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 590/1165] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:52.040811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:52.041330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:52.047254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.047724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.048149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.048827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.049268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.049707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.185252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:52.193687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ceb5d1dd-c3b7-482f-b750-b92b3d09b2de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157073 Sep 13 19:56:52.194261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 576/1166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:52.335962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:52.337979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:52.344752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.345228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.345688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.346411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.347140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.347613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.379328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8d122b79-cb1b-4123-bc5d-46f301dcf0e2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047603 Sep 13 19:56:52.379894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 591/1167] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:52.380028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:52.380500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:52.387190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.387674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.388112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.388812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.389264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.390435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.405449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:52.408982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:52.418918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.419735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.420471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.421685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.422454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.423201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.464345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9fc801d9-b19c-4a60-9477-8d3705b450c2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065696 Sep 13 19:56:52.464905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 592/1168] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:52.479941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:52.488938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-48f090a2-44df-4573-9a22-97cec5753b30 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112862 Sep 13 19:56:52.489489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 577/1169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:53.218253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:53.219015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:53.226038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.226526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.226959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.227641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.228088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.228538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.381937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:53.391694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:53.392263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e28cc4a5-51c1-4e91-8358-c1e5f3a2744a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.178033 Sep 13 19:56:53.392655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 593/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:53.393879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:53.400370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.400851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.401286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.402010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.402459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.402882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.439501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-79b98bac-2545-45ef-8e04-1d9c29722e11 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052210 Sep 13 19:56:53.440089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 578/1171] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:53.479380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:53.481565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:53.487639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.488113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.488542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.489231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.489706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.490125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.511857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:53.512469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:53.519111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.519621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.520060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.520754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.521199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.521644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.524617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-86ceacad-8240-4277-8460-76dfe5e03f33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049142 Sep 13 19:56:53.525195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 594/1172] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:53.590036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:53.596475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-960a1c1d-0b01-4b0c-af44-32431a23d982 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088408 Sep 13 19:56:53.597065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 579/1173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:54.416031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:54.416666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:54.423658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.424139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.424569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.425278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.425755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.426175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.453313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:54.455586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:54.461903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.462398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.462840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.463543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.463990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.464417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.495878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7721e51e-b6f6-4626-b5df-b18278c8ea36 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Sep 13 19:56:54.496471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 580/1174] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:54 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:54.537126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:54.539565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:54.549343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.550126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.550833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.552037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.552791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.553511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.563445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:54.571982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8692745f-7e25-4a1c-bd69-72fb95b75186 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.160045 Sep 13 19:56:54.572570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 595/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:54.584337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-14dcae76-2736-4a76-9a0b-f18254efcd5f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051266 Sep 13 19:56:54.584891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 581/1176] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:54.620047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:54.620653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:54.626579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.627059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.627490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.628185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.628636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.629058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.700147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:54.708460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fb009754-7b98-49af-8fa5-1ef6447b2b1c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092287 Sep 13 19:56:54.709020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 596/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:55.508405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:55.510590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:55.516956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.517444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.517907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.518580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.519019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.519435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.545025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:55.550814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dfc0b4db-545e-4987-824d-1e01dff5a7cd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046390 Sep 13 19:56:55.551367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 582/1178] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:55.596713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:55.597293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:55.597413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:55.599148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:55.603770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.604249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.604690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.605048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.605383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.605529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.605939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.606048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.606360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.606665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.607108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.607526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.639378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-41e74934-5c05-41cc-8938-b1792398eac6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Sep 13 19:56:55.639952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 583/1179] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:55.731916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:55.732448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:55.739110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.739596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.740032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.741899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.742468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.742974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.743423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:55.751141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-84dd308b-d0b3-4c4f-84e9-a57bc6c06152 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.158789 Sep 13 19:56:55.751816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 597/1180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:55.804790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:55.812563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a1927e1a-9fa6-4c8d-ae8d-ac6161ba07d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084650 Sep 13 19:56:55.813124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 584/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:56.562919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:56.565225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:56.571509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.571993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.572427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.573120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.573565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.574015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.605855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6b5ed289-aa3c-4327-bdc2-c2749f0d2a2f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046901 Sep 13 19:56:56.606569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 598/1182] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:56 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:56.652070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:56.654335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:56.661847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.662330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.662763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.663754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.664197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.664618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.694586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5c8ca5b8-8177-408f-ac13-6ca26c941e84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Sep 13 19:56:56.695149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 585/1183] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:56.774119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:56.774722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:56.781222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.781720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.782152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.782829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.783273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.783712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.835021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:56.835548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:56.841516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.842034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.843065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.843785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.844262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.844641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.923545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:56.931258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8144ca52-a04b-4867-9737-f778061c053a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100203 Sep 13 19:56:56.931828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 586/1184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:56.942578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:56.950412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a19ab7ee-2b84-40c3-8e30-1b5b72a1ec77 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.180121 Sep 13 19:56:56.950972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 599/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:57.618883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:57.621005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:57.626986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.627462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.627893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.628570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.629012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.629428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.660173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dc1766ff-c86b-4629-9a98-f5c2ac609fbc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Sep 13 19:56:57.660843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 587/1186] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:57 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:57.707876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:57.710071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:57.716758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.717275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.717834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.719300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.719642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.720011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.745239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:57.750405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bac131b9-fc57-459a-892e-3c427c3506be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046659 Sep 13 19:56:57.750971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 600/1187] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:57.955336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:57.959726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:57.962120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.962615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.963050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.963756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.964206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.964634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.975950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:57.976555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:57.982768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.983320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.983702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.984411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:57.984995 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:57.985251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.041548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:58.049503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c0517e5c-ad65-481a-b946-8dcafe23275e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099173 Sep 13 19:56:58.050109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 588/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:58.133205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:58.141072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-32dba834-d1c5-4915-ba6f-6d2efb9ae4bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.169828 Sep 13 19:56:58.141663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 601/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:58.672902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:58.675416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:58.682935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:58.683419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:58.683852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.684629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:58.685257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:58.685710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.719046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8fe2fa59-22a5-459b-b1a2-89b8610c5f9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050157 Sep 13 19:56:58.719617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 589/1190] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:58 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:58.762216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:58.764974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:58.772062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:58.772548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:58.773008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.773774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:58.774173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:58.774590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.807049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ca7b44ac-2132-4e59-9973-338474e83ef6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048809 Sep 13 19:56:58.807643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 602/1191] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:59.072354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:59.073088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:59.079676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.080267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.080764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.081598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.082067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.082482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.150264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:59.158253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d59f3ce3-992e-4ddb-8037-fc8f8a2b8b7f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090062 Sep 13 19:56:59.159025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 590/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:59.164766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:59.165430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:59.172532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.173818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.173818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.174320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.174804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.175231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.306048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:59.314507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-987b94fa-39eb-4db8-89d9-c8cd8c45d80b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153851 Sep 13 19:56:59.315079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 603/1193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:59.731889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:59.734666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:59.741660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.742145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.742574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.743260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.743697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.744112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.774129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3dfdda4d-50d0-4ef8-af63-2159f3fad558 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046235 Sep 13 19:56:59.774687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 591/1194] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:59 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:59.820166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:59.822338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:59.828780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.829256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.830040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.830747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:59.831190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:59.831608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:59.860907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9d5cf2b5-0ce8-47eb-9d14-72378f39933e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 13 19:56:59.861459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 604/1195] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:00.181877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.182519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.190139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.190633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.191166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.191871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.192551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.192980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.292129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:00.301134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-25ca7f8f-909e-446f-8911-b70ecd8e00da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.123122 Sep 13 19:57:00.301747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 592/1196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:00.338266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.338685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.345168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.345669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.346103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.346793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.347234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.347649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.489563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:00.497497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-74f45f86-c06b-4766-b373-4fcd0abcce10 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.163466 Sep 13 19:57:00.498108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 605/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:00.787894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.790449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.796824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.797294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.797757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.799652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.799652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.799652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.829945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-06efdf76-6b2d-418e-b269-f3aecdabcacd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Sep 13 19:57:00.830500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 593/1198] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:00 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:00.872408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.875099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.881414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.881924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.882357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.883034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.883479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.883899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.914132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a3b47d41-03ab-4130-9205-15e31524e951 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Sep 13 19:57:00.914688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 606/1199] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:01.324121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:01.324726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:01.330553 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.331025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.331451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.332155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.332612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.333015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.392790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:01.400466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-319ce550-d2bb-423b-8a36-d38f5130f5fa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.080190 Sep 13 19:57:01.401019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 594/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:01.521663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:01.522180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:01.528090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.528561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.528982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.530178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.530617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.531030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.663897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:01.675459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-40d0a46b-7f76-410f-a824-bb16e220bbbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157701 Sep 13 19:57:01.676370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 607/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:01.843101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:01.845397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:01.852087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.852571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.853019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.853749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.854209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.854633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.886720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9bb89020-69e7-48fd-b59e-08397e1855aa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Sep 13 19:57:01.887285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 595/1202] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:01 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:01.926502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:01.928719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:01.935290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.935765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.936192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.936881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:01.937320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:01.937771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:01.970749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-115625ab-c415-4c31-9364-b0d846231ad8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047811 Sep 13 19:57:01.975514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 608/1203] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:02.424380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:02.424979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:02.431047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.431544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.431971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.432653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.433095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.433511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.497402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:02.505367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-25a44179-e017-42e1-a0d9-b859f1fbd204 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085422 Sep 13 19:57:02.505958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 596/1204] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:02.699294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:02.699904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:02.707095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.707577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.708013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.708792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.709172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.709598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.840161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:02.849432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4bcdd8ee-dc35-4da9-bd76-6d9375fcb8a6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153950 Sep 13 19:57:02.850056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 609/1205] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:02.899351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:02.901480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:02.908876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.909355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.909831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.910515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.910959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.911370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.941455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bece8764-12b2-4f68-a0f4-8de08e23894d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Sep 13 19:57:02.942055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 597/1206] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:02 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:02.983074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:02.985193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:02.991713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.992243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.992683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.993382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.993869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.994297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.025385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-190e08cd-9759-4075-9209-6c8b07b00e47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Sep 13 19:57:03.025980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 610/1207] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:03.527824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:03.528426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:03.534387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:03.534859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:03.535287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.535965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:03.536404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:03.536842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.598439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:03.606244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-be1bf2d1-7478-4580-9ad2-0558f16639cf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082321 Sep 13 19:57:03.606803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 598/1208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:03.872430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:03.873093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:03.879392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:03.879861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:03.880283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.880951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:03.885140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:03.885140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.953530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:03.955808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:03.965234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:03.966044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:03.967291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.968420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:03.969154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:03.969798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.987105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:04.009872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a762b528-a823-40be-b910-027fc7885282 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060465 Sep 13 19:57:04.010639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 599/1209] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:03 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:04.022848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:04.031542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-69dfd976-ecc3-4119-8be9-7671faa811d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.162920 Sep 13 19:57:04.041710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 611/1210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:04.041884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:04.041884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:04.048970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.049459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.049934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.050637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.051190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.051523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.081657 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-389e5689-3df0-4126-ba0a-eb00cb836705 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Sep 13 19:57:04.082229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 600/1211] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:04.629919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:04.630533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:04.636556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.637036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.637470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.638193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.638647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.639733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.700189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:04.708953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9b3f2adc-1154-42ed-9eb7-7bda2d4f4880 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082947 Sep 13 19:57:04.709561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 612/1212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:05.026781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:05.028995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:05.035617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.036098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.036540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.037237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.037712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.038140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.056637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:05.057238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:05.064286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.064770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.065472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.066326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.066781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.067451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.071120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d5ff9df1-7520-4bbb-b85e-b9b1e18eb311 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048137 Sep 13 19:57:05.071708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 601/1213] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:05 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:05.094252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:05.096451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:05.102567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.103061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.103505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.104205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.104656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.105079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.138938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-564b2292-4bed-46dd-9f51-869afca7342a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048542 Sep 13 19:57:05.139523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 602/1214] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:05.200925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:05.208824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-faec5e78-0383-457a-afbf-31ed2a9b0328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155972 Sep 13 19:57:05.209396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 613/1215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:05.731121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:05.731734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:05.737974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.738454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.738890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.739575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.740023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.740442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.808439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:05.816471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-023c2380-784e-44c3-9c58-2ef252d38ad3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089221 Sep 13 19:57:05.817052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 603/1216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:06.085001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:06.087212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:06.093768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.094251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.094802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.095590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.096014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.096429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.127071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-48857daf-2407-40eb-9726-99f3b08f3341 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Sep 13 19:57:06.127634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 614/1217] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:06 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:06.151216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:06.153558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:06.160399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.160874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.161307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.162015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.162461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.162875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.194504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-460649ae-8f98-4b6d-9375-086c2fd8fb30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Sep 13 19:57:06.195076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 604/1218] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:06.400978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:06.401631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:06.408027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.408502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.408926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.409629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.410073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.410489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.609018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:06.616586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f57dcf26-3112-4387-9ca0-edad615c52e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.388321 Sep 13 19:57:06.617346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 615/1219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:06.839330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:06.839861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:06.846743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.847261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.847690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.848383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:06.848831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:06.849251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.023367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:07.031617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c524e4a6-a3a2-40a3-83cb-b9589a18801d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.196324 Sep 13 19:57:07.032820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 605/1220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:07.140426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:07.142710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:07.149037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.149517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.149995 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.150674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.151116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.151543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.181640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dc02483c-0b54-4713-a6a5-52d4e27b97bb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045149 Sep 13 19:57:07.182191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 616/1221] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:07 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:07.207380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:07.209512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:07.215871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.216344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.216842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.218040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.218491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.218906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.247699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0d622109-1c31-4fc6-85f7-0f5eb31d4b47 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Sep 13 19:57:07.248241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 606/1222] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:07.640785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:07.641396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:07.647446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.647921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.648352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.649028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.649474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.649921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.665053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:07.780560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:07.788522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c22f884a-d497-401a-8756-41747b8802fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152025 Sep 13 19:57:07.789931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 617/1223] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:08.055402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:08.056005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:08.062537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.063006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.063429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.064098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.064542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.064993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.125731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:08.133396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2fc3ed48-e43f-4d02-ab52-0d0512fc6ecc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081991 Sep 13 19:57:08.133983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 607/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:08.194448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:08.196690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:08.203137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.204129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.204277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.204905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.205349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.205801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.236501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-45551fb1-b231-4c60-9857-79602672c74d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Sep 13 19:57:08.237057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 618/1225] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:08 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:08.259848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:08.262019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:08.268338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.268816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.269247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.269963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.270455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.270822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.300738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f9e6844e-f217-4781-ac8a-74487a49587d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Sep 13 19:57:08.301274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 608/1226] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:08.811571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:08.812187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:08.818283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.818772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.819210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.819901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.820352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.820782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.954769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:08.962629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-03d7b856-fbc3-474b-a899-3b513d663445 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154807 Sep 13 19:57:08.963189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 619/1227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:09.155386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:09.155993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:09.162008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.162479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.162904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.163835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.164276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.164692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.227172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:09.234904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-58dff642-dbc1-4c78-9b8f-00692b136627 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083375 Sep 13 19:57:09.235388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 609/1228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:09.251865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:09.254493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:09.260905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.261375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.261845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.262521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.262959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.263384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.292336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-414b1c14-d4d3-4edb-87b8-830b553e9ad2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Sep 13 19:57:09.292878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 620/1229] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:09 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:09.313422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:09.315556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:09.321906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.322391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.322827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.323514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.323962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.324408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.354731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de8ec04b-4b35-418a-b8b1-c2f7a325d5ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Sep 13 19:57:09.355286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 610/1230] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:09.986782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:09.987378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:09.993264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.993787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.994202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:09.994867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:09.995306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:09.995718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.125118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:10.132953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-136f3183-1513-4e6c-81b7-6c2051324fb5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150056 Sep 13 19:57:10.133504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 621/1231] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:10.257568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:10.258192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:10.264209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:10.264688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:10.265112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.265850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:10.266297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:10.266716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.304561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:10.306758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:10.313744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:10.314229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:10.314661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.315360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:10.315803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:10.316219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.327886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:10.335713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-369f480e-966f-4260-8c20-3dc53aeca977 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081996 Sep 13 19:57:10.336286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 611/1232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:10.346437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-615dbe88-2e53-4d12-a043-a85dabd4c67c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Sep 13 19:57:10.346992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 622/1233] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:10 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:10.366734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:10.368880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:10.375338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:10.375823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:10.376263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.377113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:10.377564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:10.378144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:10.407004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-75a7b699-737d-44ff-9977-c76d1cd5c87b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Sep 13 19:57:10.407558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 612/1234] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:11.159203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:11.159803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:11.166043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.166522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.166955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.167632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.168078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.168497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.301914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:11.309675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cd8c3774-6fcf-4aa6-99f2-2f7d5d1a9b13 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154841 Sep 13 19:57:11.310306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 623/1235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:11.358822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:11.359382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:11.359501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:11.361202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:11.365964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.366441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.366870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.367579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.367734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.368017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.368219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.368434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.368651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.369328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.369812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.370230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.401377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ccc0a780-3dc7-43f3-8d1d-653bb6f715ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046150 Sep 13 19:57:11.401970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 624/1236] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:11 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:11.419524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:11.421687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:11.427485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.427962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.428390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.429280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:11.429504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:11.429948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:11.431210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:11.439686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e59a3295-91ba-4ada-acf0-271ab0190220 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084696 Sep 13 19:57:11.440254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 613/1237] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:11.459986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-97aa2d51-47a2-4af0-ba03-66d96fcce790 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Sep 13 19:57:11.460534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 625/1238] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:12.333501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:12.334145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:12.340452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.340938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.341370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.342102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.342550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.343484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.414046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:12.416187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:12.423849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.424337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.424774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.425468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.425949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.426375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.456724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-879aea7e-1e6e-4867-b0cd-dbcd3b3a2082 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Sep 13 19:57:12.457484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 626/1239] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:12 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:12.462860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:12.463460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:12.466188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:12.475695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:12.478089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.478583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.479021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.479728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.480177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.480596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.484630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cd36f6de-d95a-4a21-afa2-0c4d135b2260 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154981 Sep 13 19:57:12.486889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 614/1240] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:12.489934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:12.492139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:12.497813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.498291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.498722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.500027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:12.500622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:12.500871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:12.529763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6f04563e-cbba-476b-98c5-c8c47af4c440 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Sep 13 19:57:12.530369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 615/1241] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:12.546832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:12.554780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-614a3847-226b-480c-8efd-9ec14ec8fc39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095525 Sep 13 19:57:12.555340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 627/1242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:13.469226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:13.471397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:13.478063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.478655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.478983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.479673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.480123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.480576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.484920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:13.508347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:13.509230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:13.516185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.516387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e7027d12-9442-4528-a627-1ae4d176faff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050950 Sep 13 19:57:13.516836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.517208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 616/1243] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:13 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:13.517364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.518139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.518588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.519007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.542761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:13.544896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:13.551346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.551862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.552293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.552976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.553422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.553864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.583612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f0209a46-c751-434f-9c81-244d5d0eb3d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 Sep 13 19:57:13.584152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 617/1244] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:13.588497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:13.589093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:13.595294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.595766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.596198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.596906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.597347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.597796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.670594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:13.675189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:13.678866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-38262c7c-f2c4-4cc7-b8e0-8ec2f5a9c483 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093757 Sep 13 19:57:13.679431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 618/1245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:13.682843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-24e7abb4-807b-4033-99a4-6cc1d875798a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.178311 Sep 13 19:57:13.683388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 628/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:14.528436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:14.530634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:14.537103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.537583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.538308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.538989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.539436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.539856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.568993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ff1660e0-4fdd-4bc0-8ced-ecdf06c7a420 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Sep 13 19:57:14.569533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 619/1247] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:14 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:14.595944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:14.598189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:14.604601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.605072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.605499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.606197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.606648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.607061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.635763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e3ca8024-0205-4e7e-93bd-e8adf83bd485 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Sep 13 19:57:14.636311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 629/1248] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:14.700913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:14.701599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:14.706452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:14.707056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:14.707584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.708058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.708486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.709165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.709619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.710040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.713139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.713634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.714095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.714775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.715225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.715647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.778508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:14.786337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cc167fdc-4e31-4096-bf12-ce7c35026b3b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089190 Sep 13 19:57:14.786908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 620/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:14.865571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:14.873521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29d3e730-d60c-4269-8a74-cc856a35af30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.171016 Sep 13 19:57:14.874715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 630/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:15.581221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:15.583379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:15.589836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.590314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.590744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.591444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.592056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.592482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.622272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-170f398e-3280-4373-a811-f285b1a19940 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Sep 13 19:57:15.622820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 621/1251] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:15 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:15.648328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:15.650518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:15.657455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.657956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.658384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.659053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.659654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.660070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.688760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0cfe3fc8-01de-4249-ae23-74488ac70645 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Sep 13 19:57:15.689303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 631/1252] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:15.809699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:15.810310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:15.817089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.817559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.818019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.818688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.819130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.819546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.880120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:15.888042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-37ae01b0-9cfa-4a35-9201-e2328e15ed76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082392 Sep 13 19:57:15.888601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 622/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:15.896880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:15.897503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:15.903620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.904095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.904523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.905195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.905662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.906078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.033643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:16.041561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1d24f73a-b42d-4e4c-ba61-6ebb45777970 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.148640 Sep 13 19:57:16.042153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 632/1254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:16.634973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:16.637133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:16.643113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:16.643569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:16.643999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.644676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:16.645204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:16.645652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.675269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-00692caa-60a9-4c24-b5c5-ee0e54c4915e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Sep 13 19:57:16.675814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 623/1255] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:16 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:16.700245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:16.702447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:16.708718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:16.709190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:16.709634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.710306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:16.710748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:16.711161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.742912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d813ce49-a3d9-4d5b-8cf5-8cf27e18b92c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Sep 13 19:57:16.743468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 633/1256] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:16.911886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:16.912408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:16.919501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:16.920204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:16.920981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.922070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:16.922521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:16.922941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:16.987972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:16.995771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c578f190-131e-4bb2-ad79-5562d9f8f650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087878 Sep 13 19:57:16.996327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 624/1257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:17.064934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:17.065538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:17.071471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:17.071950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:17.072387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:17.073068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:17.073517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:17.073967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:17.076480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:17.208540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:17.216176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3ee8bafe-5025-4b40-8891-2feabe6b23d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155162 Sep 13 19:57:17.216740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 634/1258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:17.687776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:17.690547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:17.692874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:17.697994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:17.698469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:17.698901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:17.699608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:17.700051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:17.700471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:17.729789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d6d5278e-13de-47a3-90b3-1f5357a70af6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Sep 13 19:57:17.730337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 625/1259] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:17 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:17.755116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:17.757323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:17.763792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:17.764277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:17.764722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:17.765413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:17.765900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:17.766404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:17.795762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8446efa7-434e-48b7-a6af-1315b22aa0e6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Sep 13 19:57:17.796324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 635/1260] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:18.017491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:18.018071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:18.024057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.024544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.024984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.025689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.026138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.026557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.086470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:18.094798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-77b0e8ca-ca5f-47c7-80fb-6958b704316e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081024 Sep 13 19:57:18.095365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 626/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:18.240241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:18.240889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:18.247010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.247482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.247938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.248618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.249057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.249472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.379888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:18.387596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-12784b0d-8a54-4413-af0e-afd41dc6fadc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151231 Sep 13 19:57:18.388159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 636/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:18.742468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:18.744593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:18.751470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.751947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.752375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.753052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.753507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.753927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.783301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f00c6270-f0b9-4bb0-a17f-64beaab84483 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Sep 13 19:57:18.783853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 627/1263] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:18 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:18.808490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:18.810678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:18.817190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.817726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.818136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.818817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:18.819263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:18.819712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:18.849093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f1cc4728-9702-4338-afee-dd19312ee84d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Sep 13 19:57:18.849673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 637/1264] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:19.117293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:19.117920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:19.123796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.124249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.124677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.125460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.126578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.127027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.187205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:19.196117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-809bfab9-505b-46d3-b67b-ce63628c9932 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082614 Sep 13 19:57:19.196771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 628/1265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:19.411741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:19.412350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:19.419040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.419517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.419948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.420627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.421077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.421493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.550453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:19.558246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63ee52ee-9a6e-455a-8571-9cb4a7e560bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150371 Sep 13 19:57:19.558809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 638/1266] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:19.796258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:19.799248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:19.805688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.806171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.806608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.807326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.807772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.808189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.837341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-690b9ef8-f549-4d1b-a9c1-4f8f03244e27 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Sep 13 19:57:19.837915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 629/1267] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:19 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:19.861536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:19.863722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:19.869660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.870147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.870584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.871269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:19.871720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:19.872146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:19.901067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1f5e7541-7c2a-45ed-a309-ac72033cf1f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Sep 13 19:57:19.901623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 639/1268] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:20.220797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:20.221399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:20.227313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.227784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.228210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.228887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.229332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.229788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.292767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:20.300671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-900e934e-9641-44ff-aeca-482d478dc1e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084314 Sep 13 19:57:20.301232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 630/1269] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:20.582014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:20.582538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:20.590146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.590627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.591067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.591787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.592235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.592657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.730868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:20.739488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c1a1dcaa-7177-46cb-8475-b6a62231fc01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.162173 Sep 13 19:57:20.740063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 640/1270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:20.850656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:20.852745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:20.859380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.859931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.860366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.861071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.861521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.861970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.894129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2198ee65-3aab-4bb5-9d7a-be3bfaabef8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Sep 13 19:57:20.894693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 631/1271] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:20 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:20.915859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:20.918636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:20.924714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.925291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.925769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.926465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:20.926913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:20.927336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:20.959552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-46834fa1-b4e1-4ae5-b153-2391ab395e68 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049243 Sep 13 19:57:20.960129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 641/1272] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:21.322860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:21.323495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:21.330098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.330574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.331004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.331712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.332152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.332568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.394164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:21.396368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:21.403233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-41b6a023-df9c-4480-bf8d-392a88a443a6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084305 Sep 13 19:57:21.403793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 632/1273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:21.763438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:21.764037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:21.771013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.771484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.771906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.772575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.773017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.773429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.905752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:21.907301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:21.909546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:21.914512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4562a710-0c11-4886-b546-3683757bf2b4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154935 Sep 13 19:57:21.915190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 642/1274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:21.916201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.916690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.917129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.917855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.918308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.918732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.948558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5c92e180-20c8-4a21-afae-99776ba7a07f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Sep 13 19:57:21.949106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 633/1275] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:21 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:21.974196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:21.976410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:21.982554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.983036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.983469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:21.984147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:21.984622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:21.985652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:22.014489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a7480aa5-6de2-4b8f-b43c-a846c328bbdc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Sep 13 19:57:22.018674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 643/1276] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:22.425953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:22.426568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:22.432515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:22.432990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:22.433428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:22.434139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:22.434587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:22.435008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:22.495214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:22.503852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7f4247e3-dd7c-4bab-aed6-6ab3c084187b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081736 Sep 13 19:57:22.504418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 634/1277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:22.939182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:22.939798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:22.946308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:22.946775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:22.947199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:22.947865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:22.948304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:22.948715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:22.960405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:22.962570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:22.969055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:22.970169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:22.970169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:22.970711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:22.971158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:22.971585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:23.002899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1d7b7fe4-d498-4f29-a9af-b205579cc592 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046378 Sep 13 19:57:23.003504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 635/1278] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:22 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:23.027202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:23.029340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:23.035373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:23.035855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:23.036286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:23.036980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:23.037426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:23.038141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:23.068340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-42284ce1-8d97-4e0f-8e29-b873c458e9a2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Sep 13 19:57:23.069130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 636/1279] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:23.080691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:23.088566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d5c545c6-f0ef-4678-a82f-232307297a09 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154002 Sep 13 19:57:23.089125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 644/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:23.527138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:23.527744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:23.534276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:23.534756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:23.535187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:23.535868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:23.536314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:23.536735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:23.600545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:23.608520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4694c159-2ab7-448d-b187-92b3e327b336 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085212 Sep 13 19:57:23.609523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 637/1281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:24.015512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:24.017978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:24.024344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.024820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.025243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.025941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.026384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.026794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.056633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-afa0ce8b-0183-447c-bed8-401499883c73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 Sep 13 19:57:24.057101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 645/1282] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:24 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:24.080357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:24.082587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:24.089168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.089673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.090108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.090792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.091238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.091651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.112828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:24.113430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:24.119592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.120067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.120496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.121175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.121638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.122057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.122413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4d749f4c-3edf-4a50-a5e0-3ceefcde305d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Sep 13 19:57:24.122965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 638/1283] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:24.255728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:24.263607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4e4b52e0-726d-4869-b256-ceccf51a88f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155262 Sep 13 19:57:24.264172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 646/1284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:24.632188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:24.632795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:24.638839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.639324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.639762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.640444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:24.640975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:24.641882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:24.707523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:24.715226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dd974efa-0c05-40db-adc6-1bcfe37d1f36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086914 Sep 13 19:57:24.715794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 639/1285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:25.069679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:25.071874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:25.078367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.079467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.079921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.080595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.081039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.081456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.109553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-65c81673-4bfa-423a-888f-f26f37a1e25c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Sep 13 19:57:25.110634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 647/1286] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:25.134827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:25.136981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:25.143282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.143759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.144188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.144860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.145305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.145761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.174983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8317af99-6890-4c71-90c2-fdb0f7adef2c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Sep 13 19:57:25.175721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 640/1287] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:25.294114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:25.294643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:25.303287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.304439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.304851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.305650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.306105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.306525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.439894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:25.447575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-655b843d-dc04-4fff-b0ff-a9a7348914e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157389 Sep 13 19:57:25.448506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 648/1288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:25.737793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:25.738406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:25.744363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.744843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.745282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.746025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:25.746476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:25.746931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:25.808095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:25.815879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9dec9a25-ea5a-4fcc-a19a-88d61ce1f5a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082591 Sep 13 19:57:25.816442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 641/1289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:26.122486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:26.124860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:26.131281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.131761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.132196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.132884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.133331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.133788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.165247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5d913687-00d2-44d3-8aea-e87a0b10ad73 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046682 Sep 13 19:57:26.165899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 649/1290] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:26 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:26.189862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:26.192018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:26.198379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.198880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.199355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.200034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.200477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.200898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.230106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fc704e5b-a820-4db3-9613-d6b42e6fa96d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044675 Sep 13 19:57:26.230644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 642/1291] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:26.471406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:26.472000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:26.477973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.478454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.478884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.479567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.480013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.480433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.607661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:26.609921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:26.617238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2954acf9-3c5e-4e8c-bc42-39f65989a3d7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.149665 Sep 13 19:57:26.617857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 650/1292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:26.838747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:26.839268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:26.845313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.846134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.846871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.848080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:26.848847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:26.849711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:26.914880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:26.923118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a3442f0-da55-4a7e-9835-8ef2d8f5b5d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087802 Sep 13 19:57:26.923677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 643/1293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:27.178459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:27.180605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:27.187153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.187631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.188069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.189445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.189903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.190346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.222748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-47585aa5-7cff-4772-9d84-f5aecece12f1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048232 Sep 13 19:57:27.223306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 651/1294] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:27 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:27.243446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:27.245939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:27.253284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.253805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.254322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.255104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.255674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.256137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.287106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-11958cc9-15e4-4633-8717-34cb9c8bdc97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047817 Sep 13 19:57:27.287964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 644/1295] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:27.640841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:27.641463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:27.647280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.647745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.648165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.648831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.649270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.649705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.778117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:27.786337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4f7f7662-a726-4448-90e0-83982b496041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.149309 Sep 13 19:57:27.786907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 652/1296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:27.944867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:27.945393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:27.951318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.951793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.952227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:27.952905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:27.953353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:27.953803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.014225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:28.022145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fabc5a07-fcd8-4504-a167-c0b2f355ff60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081181 Sep 13 19:57:28.022708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 645/1297] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:28.235377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:28.237427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:28.243774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:28.244248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:28.244667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.245335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:28.245803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:28.246219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.275945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ba64b614-a0c2-4df8-bc3e-b4d9a6bc584a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 13 19:57:28.276492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 653/1298] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:28 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:28.299678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:28.301842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:28.308141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:28.308614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:28.309044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.309843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:28.310288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:28.310705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.339752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f7b6aeac-5cb3-4070-8b60-dce526ea5871 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Sep 13 19:57:28.340291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 646/1299] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:28.811409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:28.812118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:28.819308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:28.819782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:28.820235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.820905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:28.821403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:28.821851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:28.961062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:28.968805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d49f8d2-a8d6-4364-9f6c-a9a69dfa206a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.161248 Sep 13 19:57:28.969985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 654/1300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:29.045116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:29.045773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:29.052239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:29.052710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:29.053139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:29.053857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:29.054297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:29.054713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:29.116422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:29.124019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-94dfe6f2-bddf-4f37-88fc-3d5558aa2b16 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082801 Sep 13 19:57:29.124620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 647/1301] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:29.288266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:29.290502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:29.296860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:29.298067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:29.298423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:29.299105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:29.299551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:29.299969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:29.328913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8c5dbf7d-fafb-4bd3-acfc-1bb4bfb4088f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Sep 13 19:57:29.329453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 655/1302] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:29 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:29.354229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:29.357212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:29.364673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:29.365084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:29.365524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:29.366245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:29.366695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:29.367117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:29.396323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4fc7f648-f383-4fec-885e-200b28d269f9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047357 Sep 13 19:57:29.396901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 648/1303] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:29.993261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:29.993890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:29.999896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.000930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.001540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.002301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.002747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.003159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.133018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:30.140706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2ef9ea83-bb01-42b9-8a02-69dcfb829bc7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151314 Sep 13 19:57:30.141262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 656/1304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:30.146980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:30.147583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:30.153334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.153842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.154270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.154944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.155386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.155806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.171034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:30.220005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:30.227582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fea07f95-507e-40f1-a055-56dc1f30cfdf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084361 Sep 13 19:57:30.228137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 649/1305] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:30.341393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:30.343492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:30.350597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.351073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.351507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.352187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.352636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.353060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.382318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f47ee58-a1ab-43a4-8ebe-26cf10754226 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Sep 13 19:57:30.382884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 657/1306] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:30 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:30.409012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:30.411214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:30.417933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.418422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.418859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.419550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.420003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.420429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.449383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-09e3577e-91c8-4271-936a-1580aa998b41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Sep 13 19:57:30.449962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 650/1307] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:31.164245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.164848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.170902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.171533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.171966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.173197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.173666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.174090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.250497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.251693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.258628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.259115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.259546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.260411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.260860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.261282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.322070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:31.329952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-be0da4eb-b70c-4642-beb7-729186556de6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.169796 Sep 13 19:57:31.330520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 658/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:31.337948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:31.346517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-08898104-9fba-42f5-b466-506cc81ff3aa tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099998 Sep 13 19:57:31.347062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 651/1309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:31.395303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.397502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.403832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.404304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.404732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.405514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.405978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.406394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.435559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-706d861d-2580-4b1e-b505-17e79eeeb182 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Sep 13 19:57:31.436095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 659/1310] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:31.462327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.464478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.471393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.471873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.472340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.473024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.473470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.473924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.503379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-824c55d7-2b90-4b67-8ddc-6dab5c8c2589 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Sep 13 19:57:31.503923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 652/1311] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:32.352489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:32.353167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:32.359295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.359773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.360203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.360883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.361328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.361781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.369388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:32.370020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:32.375830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.377229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.377229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.377936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.378378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.378790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.460309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:32.468149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f570cc37-f63b-4b41-8398-12673877de12 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102448 Sep 13 19:57:32.468813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 653/1312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:32.473282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:32.475452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:32.481855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.482339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.482774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.483490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.483936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.484358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.514259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1bb60970-9e6e-4090-baba-e1549428b654 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Sep 13 19:57:32.514732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 654/1313] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:32 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:32.519977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:32.521371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:32.522130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:32.528151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.528639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.529081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.529406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8ec7790d-8f74-4eb5-be61-36176a16f19a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.180952 Sep 13 19:57:32.529840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.530017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 660/1314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:32.530645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.531132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.561079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c4a1d49e-060c-4c7e-8ccf-854336fa2d26 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Sep 13 19:57:32.561670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 655/1315] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:33.490510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:33.491116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:33.497509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.498096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.498563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.499305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.499746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.500158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.527226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:33.529392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:33.536919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.537408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.538122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.538814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.539256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.539816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.562780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:33.570580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6d8f8e1b-2890-4c30-b7c4-13c76b5535e1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 Sep 13 19:57:33.570869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2253714f-0c2d-4269-8249-9908c6e57fd3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084182 Sep 13 19:57:33.575313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 656/1316] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:33 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:33.575451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 661/1317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:33.575943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:33.576157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:33.576542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:33.578359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:33.583072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.583551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.583980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.584659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.584996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.585106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.585474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.585640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.585934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.586623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.587067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.587482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.616916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bf13a499-1454-494a-a01c-bda906a6b6dd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Sep 13 19:57:33.617484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 662/1318] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:33.720323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:33.728080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b734d038-eb51-46aa-91cf-8ef7900dcfe2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155846 Sep 13 19:57:33.728677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 657/1319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:34.582647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:34.584709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:34.591136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.591631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.592038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.592707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.593147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.593560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.594282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:34.595516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:34.601879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.602382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.602813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.603492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.603940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.604360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.625233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-448f5b8b-07b4-4cd2-9437-dbcee76d1622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046581 Sep 13 19:57:34.625872 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 663/1320] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:34 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:34.630365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:34.632479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:34.638214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.638693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.639129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.639854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.640262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.640686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.666830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:34.670856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-202ec886-6ec3-4395-83ef-2cef8de251c6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Sep 13 19:57:34.671426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 664/1321] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:34.675336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f555c90b-c76c-47f6-a57e-d5943f9509e4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084825 Sep 13 19:57:34.675897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 658/1322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:34.750017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:34.750624 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:34.756499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.756972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.757400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.758096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.758541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.758960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.886495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:34.894877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5a52fc77-f8f7-41c1-8f4e-5c17e8edeeeb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.148561 Sep 13 19:57:34.895442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 665/1323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:35.637813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.639977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:35.646436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.646914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.647347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.648028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.648473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.648895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.678223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cbd7f73f-7143-463b-a2eb-5583e63738fa tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Sep 13 19:57:35.678865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 659/1324] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:35 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:35.683803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.685965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:35.693170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.693678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.694120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.694842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.695303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.695714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.697564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.698197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:35.704072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.704557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.704994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.705699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.706149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.706571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.725265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-469063bc-b943-486a-ae30-d9504bca84b3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Sep 13 19:57:35.725876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 666/1325] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:35 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:35.769053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:35.776689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b0f03083-45db-4fdc-b18d-3257f433f991 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082845 Sep 13 19:57:35.777243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 660/1326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:35.918814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.919419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:35.926098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.926580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.927012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.927692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.928138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.928557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.943013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:36.063123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:36.070835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c59a1bd7-60b6-4420-a430-cb4ddc9c554c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155864 Sep 13 19:57:36.071398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 667/1327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:36.691311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:36.693490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:36.699940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.700412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.700842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.701524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.701990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.702416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.731468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-749856a3-1d24-4f18-bce8-89114058e711 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Sep 13 19:57:36.732017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 661/1328] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:36 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:36.738275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:36.740457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:36.746933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.747396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.747829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.748541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.748987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.749408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.778972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-25c0c853-a55f-4bf7-ac9c-d847c831fb54 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Sep 13 19:57:36.779512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 668/1329] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:36.800393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:36.801105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:36.807022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.807501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.807934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.808613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.809067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.809486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.870042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:36.878527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ad113c41-ee7d-44dc-b392-142245296889 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082255 Sep 13 19:57:36.879099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 662/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:37.093485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:37.094108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:37.100018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.100493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.100953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.101656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.102117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.102538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.234157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:37.242301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ad1bb62c-f367-460d-acaf-c76ac02e3bd6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152674 Sep 13 19:57:37.242866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 669/1331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:37.744000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:37.746190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:37.752593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.753074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.753513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.754326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.754773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.755195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.784086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7d2bb389-dee5-4597-b112-f847f10f1fdd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Sep 13 19:57:37.784635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 663/1332] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:37 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:37.791795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:37.794026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:37.801017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.801512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.801973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.803221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.803221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.803483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.832660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1cf0f8ee-8264-4639-bec0-bfb7225669c8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Sep 13 19:57:37.833204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 670/1333] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:37.901732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:37.902345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:37.909007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.909530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.909948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.910630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.911077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.911503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.972390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:37.980212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dad859ed-d34e-4a0e-a116-c4540180dbc4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082345 Sep 13 19:57:37.980763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 664/1334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:38.265638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:38.266248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:38.272751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.273166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.273590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.274296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.274741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.275154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.407632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:38.415560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0f8d1c2d-1ffe-4603-89be-b347d3b48a84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153804 Sep 13 19:57:38.416149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 671/1335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:38.797119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:38.799834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:38.806396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.806876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.807308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.807990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.808431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.808847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.840623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a205c452-771b-4d33-b4ed-3485adbc232c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047184 Sep 13 19:57:38.845312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 665/1336] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:38 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:38.845462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:38.846777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:38.853102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.853574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.854031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.854713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.855151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.855566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.886635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5cae5ad6-23ff-4c0e-988f-ff44b6c1beed tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Sep 13 19:57:38.887185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 672/1337] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:39.002611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.003255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.009083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.009567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.010052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.010748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.011200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.011628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.015665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:39.074360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:39.082086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c3741e59-5f6b-4be8-a63c-6ff448ee6341 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083407 Sep 13 19:57:39.082652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 666/1338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:39.439511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.440114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.446033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.446513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.446946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.447637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.448136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.448508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.581151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:39.588802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e872d98b-ae67-4060-9c2b-61438476d430 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153437 Sep 13 19:57:39.589368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 673/1339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:39.852510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.854688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.861166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.861673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.862113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.862800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.863244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.863665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.894076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ed91c41a-4eee-4fe5-a0d8-935c376a0d31 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Sep 13 19:57:39.894638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 667/1340] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:39 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:39.899343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.901506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.907866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.908347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.908784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.909469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.909946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.910373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.941915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c61101c4-1b9b-4dab-9e8c-58583124c46d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Sep 13 19:57:39.942477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 674/1341] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:40.104630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:40.105152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:40.112387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.112861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.113290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.113992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.114437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.114854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.176966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:40.184599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d0fe9744-16f2-474e-bc1b-9481d017f574 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084120 Sep 13 19:57:40.185145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 668/1342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:40.612982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:40.613581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:40.619512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.619980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.620402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.621070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.621513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.621956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.754952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:40.762732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e906790c-1f2e-4779-b73a-0f3b2f6f1e97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154228 Sep 13 19:57:40.763302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 675/1343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:40.905732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:40.908441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:40.915233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.915704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.916134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.916810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.917252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.917695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.945856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0b4e11f3-d604-4902-ab46-662e8e214e22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Sep 13 19:57:40.946395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 669/1344] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:40 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:40.955003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:40.957171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:40.963506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.963986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.964415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.965101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.965545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.965988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.995409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3facab19-bd83-494d-a4fb-23c0db7c5eac tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Sep 13 19:57:40.995954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 676/1345] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:41.208276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:41.208806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:41.214744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.215221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.215656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.216331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.216776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.217192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.278449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:41.286148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-39a05289-9cf8-47fc-ae1e-603b3f0035e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082470 Sep 13 19:57:41.286708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 670/1346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:41.786031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:41.786639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:41.789149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:41.794696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.795220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.795676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.796353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.796795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.797210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.926750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:41.934496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eea33cf2-53a2-41f7-ac31-10d1390eaa1c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152346 Sep 13 19:57:41.935064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 677/1347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:41.958243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:41.960433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:41.966754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.967238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.967779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.968463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.968908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.969333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.999036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2399cb9f-e0f4-47ff-863a-b2149646942e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Sep 13 19:57:41.999906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 671/1348] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:41 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:42.011210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:42.013354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:42.020135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.020617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.021197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.022027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.022477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.022894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.053132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-206c691a-d644-4709-b52f-8c9b764a23d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045788 Sep 13 19:57:42.053627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 678/1349] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:42.309215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:42.309793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:42.315730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.316208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.316644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.317321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.317795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.318217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.379428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:42.387331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b35ab2ac-3042-4a1b-876a-5a623ba9e65b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082092 Sep 13 19:57:42.387885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 672/1350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:42.958332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:42.958935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:42.965143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.965633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.966092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.966775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.967224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.967648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.011318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:43.013564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:43.021352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.021866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.022306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.023006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.023452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.023872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.054490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5ea34d03-c466-47ca-894d-12bb648c2818 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047076 Sep 13 19:57:43.055050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 673/1351] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:43.065833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:43.067957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:43.073706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.074183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.074616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.075298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.075740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.076154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.100190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:43.104933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-be5f6d7f-3517-4b56-b7b5-517a3590b36c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043622 Sep 13 19:57:43.105519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 674/1352] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:43.111157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-79475389-cdc7-4bdb-9f2b-3018d88e19ed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156616 Sep 13 19:57:43.111710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 679/1353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:43.410908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:43.411509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:43.413640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:43.419426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.419896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.420324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.420998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.421441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.421882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.482564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:43.490853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4bbd6a0c-e4c6-4b3e-aad4-48f1e451807e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084361 Sep 13 19:57:43.491407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 675/1354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:44.066863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:44.069039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:44.071410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:57:44.071581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 19:57:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments (ip 10.222.0.23) !!! Sep 13 19:57:44.078937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.082248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.082687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.083376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.083821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.084240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.117563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:44.119748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:44.122125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a83a021d-22f5-49c2-bc78-965f4bd7fd98 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059251 Sep 13 19:57:44.122694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 680/1355] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:44.126361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.126841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.127276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.127968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.128409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.128829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.134748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:44.135387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:44.142122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.142622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.143050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.143954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.144634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.145059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.159620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8ca64869-325b-46f0-95ed-ae4ddaa1365f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046201 Sep 13 19:57:44.160175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 676/1356] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:44.276261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:44.284076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9d458a6-926d-4301-8a55-d1744958b626 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153657 Sep 13 19:57:44.284646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 681/1357] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:44.514103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:44.514678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:44.521133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.521597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.522063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.522736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.523180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.523595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.583655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:44.591197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-19b5695b-a064-4c71-a655-f0b255b98520 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.080976 Sep 13 19:57:44.591745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 677/1358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:45.134971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:45.137159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:45.143748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.144223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.144654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.145331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.145803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.146223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.172317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:45.175086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:45.177887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-424ad2fe-be9e-4df9-aed2-2b26025a6761 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Sep 13 19:57:45.178457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 682/1359] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:45.181589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.182089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.182517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.183198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.183638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.184053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.212967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0dcf7e59-4f14-4b31-85d9-c3ccbd641cd1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Sep 13 19:57:45.213508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 678/1360] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:45.307229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:45.307754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:45.313577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.314081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.314507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.315174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.315613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.316031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.448750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:45.458006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-233c55d5-ce2d-49be-8779-ef1ed0c45178 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154504 Sep 13 19:57:45.458713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 683/1361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:45.614308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:45.614916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:45.620693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.621167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.621595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.622311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:45.622756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:45.623173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:45.683751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:45.692176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4d40c2d1-fc0a-448a-890c-1219fe864730 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082220 Sep 13 19:57:45.692730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 679/1362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:46.191097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:46.193229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:46.199735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.200205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.200630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.201300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.201766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.202185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.204468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:46.225576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:46.227751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:46.232032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-05955cae-b51a-4ccb-82b4-f459b474f1e4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Sep 13 19:57:46.232758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 684/1363] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:46 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:46.234090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.234574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.235009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.236237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.236686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.237106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.266566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dfadb47b-0a17-4b1c-9eaf-392c18566a73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Sep 13 19:57:46.267042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 680/1364] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:46.481483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:46.482107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:46.488513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.488982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.489414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.490112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.490555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.490967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.622346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:46.630232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f37ea1e-81b2-4758-afed-b6863de4d80c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152596 Sep 13 19:57:46.630802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 685/1365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:46.715362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:46.715969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:46.722659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.723135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.723568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.724245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:46.724697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:46.725117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:46.784984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:46.792882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a8cb7bad-ca40-483f-a8b1-8fc646584a5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081403 Sep 13 19:57:46.793437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 681/1366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:47.245100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:47.247284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:47.254144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.254616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.255045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.255715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.256158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.256573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.278398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:47.280490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:47.286530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fb814c45-89e0-41a2-82e0-0928859f0ae8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Sep 13 19:57:47.286627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.287061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 686/1367] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:47 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:47.287448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.287838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.288533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.288982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.289403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.314481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:47.319711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-885509b1-5908-4b95-a0c5-b7ca6c24346b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Sep 13 19:57:47.320260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 682/1368] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:47.653463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:47.654189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:47.660107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.660577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.661000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.661697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.662406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.662821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.795007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:47.803385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ed517923-24bf-46de-8c9f-4bc6a36f834d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153706 Sep 13 19:57:47.803948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 687/1369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:47.816302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:47.816908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:47.823156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.823650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.824077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.824751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:47.825193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:47.825625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:47.886445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:47.894235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6d68397-1dac-4602-9a78-38c1b60bcfa8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082616 Sep 13 19:57:47.894802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 683/1370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:48.299990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:48.302102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:48.308506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.308988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.309424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.310234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.310687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.311139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.332965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:48.335222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:48.340849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dfc272a6-6513-4714-9e0c-ff2064dbffea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 Sep 13 19:57:48.341061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.341412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 688/1371] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:48.341558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.342066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.342847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.343307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.343736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.373135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9f084ca0-541e-4e22-b68e-b5d03899b27d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Sep 13 19:57:48.373734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 684/1372] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:48.827673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:48.828299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:48.834922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.835398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.835826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.836501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.836947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.837364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.916417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:48.917020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:48.924324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.924862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.925290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.926000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:48.926462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:48.926879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:48.974134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:48.981748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d8f98d08-3fec-4fb0-95dc-aa6840d9e414 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.158092 Sep 13 19:57:48.982321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 689/1373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:48.989973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:48.997646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f6ae5734-ce24-4882-9a80-723cf833b515 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085291 Sep 13 19:57:48.998245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 685/1374] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:49.354034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.356203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:49.362627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:49.363103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:49.363535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:49.364213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:49.364659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:49.365079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:49.385376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.387577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:49.393753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:49.394238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:49.394672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:49.395083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5f320340-9979-4c4b-9902-56535bbe5596 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Sep 13 19:57:49.395542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:49.395673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 690/1375] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:49.396346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:49.396838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:49.427493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0110cd4c-71c5-4fdd-8224-b376848a6439 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046079 Sep 13 19:57:49.428039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 686/1376] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:50.004842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:50.005364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:50.011780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.012260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.012725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.013416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.014433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.014433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.021503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:50.022256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:50.028526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.029005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.029439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.030163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.030609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.031029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.113527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:50.121222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-86ed63da-4be3-4140-b15f-62f6841cadae tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104308 Sep 13 19:57:50.121809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 687/1377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:50.172908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:50.180593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e85b43c2-db3c-4674-9d74-188269d311ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.179743 Sep 13 19:57:50.181160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 691/1378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:50.407560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:50.409892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:50.416143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.416624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.417059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.417780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.418226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.418647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.441679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:50.443861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:50.449511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fe16ad48-42ed-4ed8-a402-bf8ea561ed1c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046184 Sep 13 19:57:50.449721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.450105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 688/1379] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:50.450280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.450619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.451303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:50.452037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:50.452559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:50.482547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-92a62799-ae0a-470e-a55e-e903f742a382 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Sep 13 19:57:50.483085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 692/1380] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:51.143848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:51.144381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:51.150839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.151307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.151737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.152402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.152844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.153258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.204349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:51.204960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:51.211591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.211820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.212249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.213050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.213498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.213937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.214085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:51.222580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0f53c071-12fb-4bde-b71e-a31381393638 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082934 Sep 13 19:57:51.223238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 689/1381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:51.349027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:51.356717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2bb7d0f6-0626-4ecc-8f38-80842371f98d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156303 Sep 13 19:57:51.357275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 693/1382] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:51.463266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:51.465341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:51.472634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.473211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.473573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.474280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.474726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.475149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.494733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:51.496885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:51.502932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.503422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.503862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.504551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.505005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.505456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.505560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1a5de9a6-c1b9-455b-ba59-11f282b1885b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046320 Sep 13 19:57:51.506101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 690/1383] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:51 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:51.536082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4339db09-2c3a-4b4e-b4ab-586bd3fd30aa tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Sep 13 19:57:51.536639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 694/1384] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:52.246026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:52.246672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:52.253584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.253990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.254609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.255301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.255853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.256504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.317325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:52.325236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8b717f28-1361-4c81-91ef-a4473c62414b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083225 Sep 13 19:57:52.325821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 691/1385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:52.379422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:52.380022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:52.386327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.386798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.387221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.387888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.388325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.388757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.518389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:52.521197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:52.521327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:52.527356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.527844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.528280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.528976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.529367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ec76d44d-3b52-4263-938d-65570f73dcee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153755 Sep 13 19:57:52.529493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.529863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.529968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 695/1386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:52.548259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:52.550430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:52.556289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.556777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.557209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.557918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.558369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.558791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.559262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4181e032-05ec-4504-be24-f23fda7070a3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Sep 13 19:57:52.559820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 692/1387] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:52.588787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9d6b76d7-31fd-4196-91aa-59968d268323 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Sep 13 19:57:52.589336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 696/1388] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:53.349035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:53.349564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:53.355977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.356456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.356896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.357578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.358048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.358466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.421836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:53.430226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-df508e7e-ecf4-4b8c-9e78-29a575f4da54 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085785 Sep 13 19:57:53.430790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 693/1389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:53.552650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:53.553266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:53.559960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.560428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.560857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.561526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.561993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.562407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.573884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:53.576042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:53.582531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.583009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.583444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.584134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.584588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.585012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.615119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6128f5aa-1478-4569-9efd-8272d18f0fa8 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046242 Sep 13 19:57:53.615684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 694/1390] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:53.620316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:53.622478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:53.628359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.628849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.629318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.630239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.630756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.631194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.662293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-94dfe9fc-6b2b-4029-8ba0-9ad819dd7094 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Sep 13 19:57:53.662865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 695/1391] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:53.693783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:53.701473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-759b854d-fc78-46b7-8c44-9d5930a918f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152622 Sep 13 19:57:53.702065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 697/1392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:54.452477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:54.453080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:54.455884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:57:54.456031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 19:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b (ip 10.222.0.23) !!! Sep 13 19:57:54.468158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.468624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.469049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.469762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.471062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.471724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.534285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:54.542107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3a68a347-6c8c-4f5a-bf4a-0a87ddc2d010 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093501 Sep 13 19:57:54.542662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 696/1393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:54.627380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:54.629630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:54.636221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.636703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.637142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.637849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.638299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.639049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.668827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-23b5ea10-0229-4d85-bf01-af05f1cc3cae tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045402 Sep 13 19:57:54.669381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 698/1394] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:54 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:54.673843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:54.676030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:54.681964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.682446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.682880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.683559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.684008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.684426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.714140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0dcb7390-2675-4354-a535-e5a68b2aa83b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Sep 13 19:57:54.714624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 697/1395] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:54.724133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:54.724744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:54.730667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.731143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.731578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.732260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.732709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.733131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.872567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:54.880761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1ef8d070-03e5-43af-ae0d-e4c6de4b974e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.160395 Sep 13 19:57:54.881328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 699/1396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:55.564980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:55.565586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:55.571592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.572073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.572510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.573188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.573660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.574089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.638176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:55.646418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0783c66f-15a5-448e-b38c-3d1e6a2c1be1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086384 Sep 13 19:57:55.647015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 698/1397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:55.681063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:55.683274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:55.690194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.690674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.691111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.691790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.692238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.692657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.718083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:55.723418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b1d579bf-12c3-4ee3-9f94-5da65584273e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046331 Sep 13 19:57:55.723979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 700/1398] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:55.726693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:55.728859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:55.734777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.735258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.735747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.736442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.736888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.737305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.750864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:55.767784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-038806ce-19ff-4445-bfaf-7d95ec154b84 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Sep 13 19:57:55.768331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 699/1399] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:55.904334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:55.904929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:55.910946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.911419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.912126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.912803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:55.913240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:55.913677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.042504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:56.050924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0ba72364-2ad4-42e1-8037-4422217ef436 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150421 Sep 13 19:57:56.051491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 701/1400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:56.668982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:56.669752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:56.676643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.677118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.677550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.678247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.678695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.679114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.736360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:56.738877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:56.743008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:56.745568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.746090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.746520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.747269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.747711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.748128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.751177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f1dc02b3-a915-418d-8219-fc0445c0b675 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086009 Sep 13 19:57:56.752380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 700/1401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:56.778241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5e1cc72c-3aee-4df9-a58a-61f28e0f5ca0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Sep 13 19:57:56.778789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 702/1402] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:56 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:56.780540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:56.782720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:56.788934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.789413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.789871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.790559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.791003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.791424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.821352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-785b3a4c-3119-4541-a21b-3d84b6f933d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Sep 13 19:57:56.821924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 701/1403] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:57.074947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:57.075582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:57.081684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.082161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.082616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.083295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.083743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.084163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.212649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:57.221983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-25da4580-49a2-4ad1-8b7f-99c2893a817f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150904 Sep 13 19:57:57.222542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 703/1404] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:57.774303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:57.775064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:57.781344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.781919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.782377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.783030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.783467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.783883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.790866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:57.793032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:57.799433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.799909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.800333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.801011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.801450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.802268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.833157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d8694fce-a1ec-4f54-8811-5971a351d0ff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046456 Sep 13 19:57:57.833932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 704/1405] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:57 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:57.838530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:57.840627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:57.847056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.847539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.847975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.849048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.849259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.849715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.851691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:57.859490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6be48855-79cc-4d81-aeb1-ce21436f24f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089044 Sep 13 19:57:57.860052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 702/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:57.879683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-65873920-a2d0-4f48-90f7-ad3424bace12 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Sep 13 19:57:57.880233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 705/1407] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:58.245407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:58.246033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:58.252632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.253100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.253526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.254218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.254658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.255070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.385884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:58.393760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4c22308d-0cdd-419a-b3d8-9655a8c7b889 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152015 Sep 13 19:57:58.394209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 703/1408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:58.846173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:58.848304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:58.854674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.855145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.855573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.856245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.856686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.857123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.881577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:58.882202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:58.886037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-31f4f2e8-86c6-49ec-a8b5-399c59c5c98a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Sep 13 19:57:58.888785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.889271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.889723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.890076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 706/1409] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:58 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:58.890495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.890942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.891379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.895463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:58.897634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:58.903364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.904009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.904569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.905263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.905731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.906151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.936172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-92b3e949-b44c-4da8-9916-3ea6ac2f98ad tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Sep 13 19:57:58.936744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 707/1410] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:58.954329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:58.962599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aa196ff6-f690-445c-b922-f0d797cd8e3c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084878 Sep 13 19:57:58.963154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 704/1411] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:59.416632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:59.417265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:59.423278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.423754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.424188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.424864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.425306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.425754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.560368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:59.569908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-be788e82-c836-45ee-9bf7-d4f6daa88abe tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157159 Sep 13 19:57:59.570485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 708/1412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:59.897517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:59.899717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:59.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.906701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.907139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.908333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.908780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.909202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.940527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-af7f2657-5e98-4ff6-8f1f-a427a24fb617 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046910 Sep 13 19:57:59.941080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 705/1413] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:59 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:59.948279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:59.950427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:59.956764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.957249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.957732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.958421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.958871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.959291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.985669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:59.986844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:59.990776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0fabebd6-bb8a-4667-8554-2b93a770a32b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Sep 13 19:57:59.991342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 709/1414] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:59.992768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.993313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.993733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.994425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.994884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.995303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.060440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:00.068527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6e072a19-e61f-46e7-9520-062643ee4c46 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086670 Sep 13 19:58:00.069061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 706/1415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:00.593458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:00.594088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:00.600644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:00.601126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:00.601559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.602272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:00.602720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:00.603139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.734414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:00.742363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7c5ff285-3208-43eb-b12c-6f0e6a998c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.152866 Sep 13 19:58:00.742941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 710/1416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:00.952829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:00.955757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:00.962565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:00.963039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:00.963466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.964150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:00.964722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:00.965143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.994111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d47efef6-213a-4d42-9940-31e2b502618c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Sep 13 19:58:00.994654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 707/1417] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:00 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:01.002870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:01.005042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:01.011456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:01.011940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:01.012378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:01.013214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:01.013633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:01.014059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:01.045438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-75da4a9d-65a0-4c5e-a810-d57f27b22db6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046929 Sep 13 19:58:01.046098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 711/1418] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:01.090989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:01.091633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:01.097699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:01.098185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:01.098627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:01.099309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:01.099759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:01.100184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:01.162469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:01.170384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2f703939-470f-4f4a-87d4-f5b398325fb0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083211 Sep 13 19:58:01.170957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 708/1419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:01.766427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:01.767527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:01.773541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:01.774041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:01.774464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:01.775137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:01.775578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:01.775993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:01.911079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:01.918894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-61a8cd48-ea2b-43cd-a2d3-52fa7ad490de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.156320 Sep 13 19:58:01.919485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 712/1420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:02.007133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:02.009334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:02.016859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.017893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.018402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.019094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.019629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.020057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.052850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ce177789-c599-4d96-819d-18f0f9c5f4be tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Sep 13 19:58:02.053413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 709/1421] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:02 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:02.059669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:02.062009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:02.067954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.068438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.068890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.069643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.070099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.070523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.102150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5017dcc4-419a-45c5-97a4-f83f203851ab tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Sep 13 19:58:02.102960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 713/1422] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:02.193177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:02.193822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:02.199789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.200273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.200802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.201407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.201879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.202305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.264541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:02.275255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5cb18e3b-9c6f-4e1b-8593-a53a50aa301b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086342 Sep 13 19:58:02.275858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 710/1423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:02.941927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:02.942535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:02.948439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.948916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.949344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.950052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.950535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.950998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.065565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:03.067728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:03.074163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.074644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.075076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.075991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.076299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.076721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.080773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:03.088512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8f657a65-71bb-49b7-bddd-08c55b87f1ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.150558 Sep 13 19:58:03.089080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 714/1424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:03.106897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b301c345-9979-49ee-8389-ef42ccc01463 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Sep 13 19:58:03.107449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 711/1425] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:03 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:03.115492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:03.117646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:03.123490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.123969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.124401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.125103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.125550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.125993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.155543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ae48ea28-1e9f-42d1-8e55-b67f61e9d6d0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Sep 13 19:58:03.156099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 715/1426] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:03.298570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:03.299095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:03.305212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.305727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.306163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.306846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.307292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.307711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.372924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:03.380805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6ec0c32e-9544-490b-871d-c594f6524c33 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086151 Sep 13 19:58:03.381372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 712/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:04.116058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:04.116058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:04.120082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:04.121634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.122251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:04.122372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.122681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.123395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.123906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.124323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.129239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.129716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.130158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.130855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.131299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.131723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.162523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-02091d2a-f7fe-4822-ae02-bca283f3313a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Sep 13 19:58:04.163612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 713/1428] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:04 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:04.171368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:04.174420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:04.180431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.180920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.181368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.182109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.182572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.182993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.213253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b46b4c1e-6c79-4473-be0e-6813c9f7aba4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Sep 13 19:58:04.213849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 714/1429] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:04.261442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:04.269560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d38ed4c6-1279-4147-bc0d-1df8b7fd50aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.160630 Sep 13 19:58:04.270146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 716/1430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:04.404366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:04.404885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:04.411394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.412127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.412557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.413236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.413707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.414133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.475032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:04.482658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6869e47f-e877-43e5-a1e5-cb1db1d5e691 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082234 Sep 13 19:58:04.483244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 715/1431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:05.175475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:05.177637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:05.183959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.184434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.184862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.185532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.185996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.186411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.200172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:05.216540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d106431f-89b8-40cd-805d-97fa05cac694 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Sep 13 19:58:05.217086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 717/1432] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:05 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:05.225405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:05.227601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:05.234000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.234483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.234918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.235600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.236046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.236466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.240077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:05.266888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-611c0413-6a7b-4a39-85e0-4ac94c4f1ef8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045242 Sep 13 19:58:05.268074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 716/1433] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:05.292975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:05.293528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:05.299547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.300171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.300603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.301305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.301757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.302174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.435923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:05.444176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-45a4dc41-11cf-49e3-bc68-f117c24a67f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.155109 Sep 13 19:58:05.444750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 718/1434] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:05.506237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:05.506851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:05.513092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.513581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.514040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.514738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.515187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.515612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.577983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:05.586046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7ee79862-1d5f-49c3-bcf1-393cd3963fd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083649 Sep 13 19:58:05.586613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 717/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:06.229206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:06.231371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:06.238385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.238858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.239288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.239963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.240401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.240813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.270483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4be9164b-5337-4359-816f-9680b13a0043 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Sep 13 19:58:06.270951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 719/1436] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:06 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:06.279619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:06.281792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:06.289263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.289786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.290222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.290904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.291356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.291780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.321013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-48dbb593-3188-4c12-b7ea-7fecbde96c85 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Sep 13 19:58:06.321563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 718/1437] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:06.468369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:06.468975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:06.475563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.476071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.476505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.477181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.477645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.478071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.605565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:06.608254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:06.609023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:06.613441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fe1a7b10-6fd1-4c5a-9e93-f8e366c450fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.148926 Sep 13 19:58:06.614051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 720/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:06.615077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.615556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.615992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.616680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:06.617122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:06.617535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.683724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:06.692171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-209fa671-efac-440f-b792-7dbf21d01660 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087743 Sep 13 19:58:06.692737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 719/1439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:07.283123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:07.285287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:07.293465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.293962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.294392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.295828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.296335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.296779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.330730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c0cd7543-2c9a-4f5e-9fa6-31943ac51ccc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051701 Sep 13 19:58:07.332711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:07.335000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:07.335632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 721/1440] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:07 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:07.341754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.342251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.342708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.343432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.343883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.344304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.378935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-09ab2ad4-db78-48e9-8222-a92cbb256961 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050166 Sep 13 19:58:07.379761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 720/1441] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:07.638095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:07.638699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:07.644759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.645250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.645717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.646415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.646866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.647318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.715478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:07.716082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:07.723033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.723510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.723947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.724868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:07.725061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:07.725885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:07.846682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:07.854395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1dd74f42-933a-4b66-8672-cb1f48cd99f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.142740 Sep 13 19:58:07.854955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 721/1442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:07.897320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:07.905165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5d98bbda-b3cc-48c2-87b7-d70161176968 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.270814 Sep 13 19:58:07.905780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 722/1443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:08.343273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:08.345406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:08.351871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.352342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.352769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.353437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.354018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.354527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.383966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-550db35b-ede0-41af-9819-cd1877b7fe7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Sep 13 19:58:08.384518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 722/1444] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:08 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:08.391714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:08.394446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:08.401227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.401744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.402178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.402866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.403313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.403730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.433846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-62984e65-2564-4c13-9145-49e16bb9ed8e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046071 Sep 13 19:58:08.434403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 723/1445] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:08.878247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:08.878849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:08.884704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.885174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.885601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.886300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.887324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.887771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.929703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:08.930314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:08.936228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.936701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.937130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.937928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.938403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.938811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.948569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:08.956247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b5a3c255-59ae-47ca-bacc-b6cc82ffffc2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082500 Sep 13 19:58:08.956997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 723/1446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:09.071882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:09.079642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-843cce2f-42ec-492b-bd5c-c96dbbdcc3c4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.153856 Sep 13 19:58:09.080285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 724/1447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:09.397086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:09.399271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:09.405851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:09.406331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:09.406763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:09.408106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:09.408548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:09.408971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:09.440218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4e5f5da3-fbee-4a50-8eac-80fcdefeff61 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Sep 13 19:58:09.440767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 724/1448] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:09 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:09.446421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:09.448639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:09.455907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:09.456388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:09.456819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:09.457512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:09.457998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:09.458413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:09.489993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2ca04474-3707-4ada-a389-7b5decd6e317 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047434 Sep 13 19:58:09.490568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 725/1449] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:09.978570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:09.979213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:09.981146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:09.986500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:09.986980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:09.987413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:09.988103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:09.988542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:09.988955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.053674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:10.062032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3f95314b-f180-49de-b84b-f1e29d64650d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087231 Sep 13 19:58:10.062623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 725/1450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:10.104281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:10.104803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:10.111568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:10.112056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:10.112496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.113200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:10.113674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:10.114236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.273400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:10.281588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f82356f-4046-4974-9b73-ceae0ccf60f1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.181286 Sep 13 19:58:10.282249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 726/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:10.452621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:10.454815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:10.461503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:10.462102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:10.462533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.463229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:10.463669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:10.464082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.498824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8d6987c3-1942-4d8d-8322-3af429f78c65 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050110 Sep 13 19:58:10.499418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 726/1452] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:10 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:10.502969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:10.505210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:10.507681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.513551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:10.513831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:10.514250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.514959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:10.515405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:10.515826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:10.550040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-333e1409-b15d-40b3-89b7-9166daf03fa4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050912 Sep 13 19:58:10.550646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 727/1453] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:11.085838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:11.086447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:11.092614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.093104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.093565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.094263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.094790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.095736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.158802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:11.167131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-28331795-c1e1-4bb6-9043-a7daa6206bf6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085187 Sep 13 19:58:11.167713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 727/1454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:11.307978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:11.308499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:11.315029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.315507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.315938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.316619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.317068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.317484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.453078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:11.461720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71fef8d9-e427-46fb-8b1c-72ec31b4d502 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157654 Sep 13 19:58:11.462308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 728/1455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:11.511391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:11.513625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:11.520920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.521485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.521888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.522589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.523041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.523469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.556994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-db40f570-ba0e-4de5-8bb1-99f06c592620 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049449 Sep 13 19:58:11.557777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 728/1456] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:11 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:11.564263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:11.566438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:11.573019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.573501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.573975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.574674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:11.575122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:11.575546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:11.606628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9bc3ab0-b1df-424a-a6c9-ecef13100743 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Sep 13 19:58:11.607288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 729/1457] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:12.189016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:12.189642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:12.195621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.196093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.196517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.197192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.197660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.198081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.261315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:12.269716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b25a3ff4-4697-4fac-9a12-c213df7de648 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084743 Sep 13 19:58:12.270278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 729/1458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:12.484449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:12.484961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:12.491219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.491701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.492129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.492814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.493258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.493715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.569496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:12.572073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:12.579601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.580139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.580522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.581263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.581731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.582149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.614681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-77f3dbdd-3360-463d-94ac-727a1eb88f75 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049057 Sep 13 19:58:12.615497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 730/1459] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:12 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:12.620358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:12.622886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:12.630774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.631586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.632163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.632592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:12.633056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:12.633562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:12.634092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:12.641061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a252b9b9-6dea-42dc-b604-f3f6ecb26ea8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.160422 Sep 13 19:58:12.641696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 730/1460] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:12.670416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ede5ca3-e61d-4eb7-ae0e-b5a8d095d169 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053797 Sep 13 19:58:12.671029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 731/1461] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:13.293440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:13.294074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:13.300052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.300519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.300950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.301682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.302128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.302547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.362944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:13.370640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7396f64e-c359-4036-abcb-e83541f71fbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081195 Sep 13 19:58:13.371203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 731/1462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:13.628380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:13.630556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:13.636979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.637462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.637929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.638611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.639049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.639464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.664538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:13.664744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:13.665857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:13.671849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b28aea8c-e33a-4ebb-996d-946f15eb6698 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048881 Sep 13 19:58:13.672052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.672422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 732/1463] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:13 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:13.672544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.673758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.674527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.674992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.675549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.683184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:13.685313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:13.691957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.692429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.692862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.693552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:13.694023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:13.694435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:13.725595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e2faab82-9c53-4b58-bf42-932d21874783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046181 Sep 13 19:58:13.726578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 733/1464] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:13.815183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:13.823261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-69823e3a-9e97-4c84-88f3-fe2f0019de0f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.162881 Sep 13 19:58:13.823953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 732/1465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:14.393795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.394406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:14.400385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.400862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.401297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.402018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.402470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.402889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.464543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:14.472823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d17722a2-1e4d-4016-a2c6-2ba9e3e95cee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082962 Sep 13 19:58:14.473382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 734/1466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:14.684417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.686604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:14.692889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.693360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.693827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.694504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.694941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.695356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.726208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9874add0-dc12-49ec-ab12-3bdc968316c5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Sep 13 19:58:14.726763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 733/1467] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:14.738420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.740576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:14.746962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.747448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.747908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.748596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.749048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.749473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.779443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d2f4a8fa-f2c6-452f-9c3d-ba3ec849d71a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Sep 13 19:58:14.779994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 735/1468] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:14.846880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:14.847488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:14.853414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.853925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.854358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.855035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:14.855481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:14.855899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:14.859855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:14.986515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:14.994289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4084eed4-7e51-4ba8-9e07-59874655cf5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.151857 Sep 13 19:58:14.994949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 734/1469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:15.495890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:15.496484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:15.503290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:15.503763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:15.504196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:15.504910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:15.505358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:15.505841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:15.568736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:15.576552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-be7f4e43-3429-40c4-9591-3b9dbb266eb8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084583 Sep 13 19:58:15.577111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 736/1470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:15.739509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:15.741711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:15.748314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:15.748723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:15.749158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:15.749878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:15.750319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:15.751276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:15.781938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-45c92ae1-10f9-443f-a8f8-8327e0d2d9ac tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046364 Sep 13 19:58:15.782501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 735/1471] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:15 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:15.792513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:15.795158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:15.804861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:15.805353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:15.805828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:15.806534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:15.806980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:15.807402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:15.838522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0c7380a8-4933-468a-bc41-1295981a9d06 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049892 Sep 13 19:58:15.839075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 737/1472] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:16.018931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:16.019543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:16.026080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.026610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.027114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.027816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.028311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.028727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.164232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:16.171927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fe9762f6-9906-43eb-a568-47399c71dede tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.157214 Sep 13 19:58:16.173106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 736/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:16.600063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:16.600674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:16.606870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.607379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.607821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.608509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.608991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.609414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.669581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:16.677738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d9ab1bdf-2597-41e1-9c07-4c17745775dc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081546 Sep 13 19:58:16.678293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 738/1474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:16.794715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:16.796885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:16.803820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.804293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.804724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.805399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.805862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.806276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.838717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-461f19bf-cdbc-4388-8cd3-7abfa072e47b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047910 Sep 13 19:58:16.839273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 737/1475] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:16 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:16.851311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:16.853413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:16.859480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.860528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.860967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.861678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:16.862129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:16.862548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:16.891919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2d14734a-b129-4dda-8096-03309ba37856 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Sep 13 19:58:16.892499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 739/1476] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:17.196043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:17.196652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:17.202789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.203263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.203698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.204376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.204819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.205237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.583937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:17.591627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9e9c04f9-df08-4fed-83b3-805c32a0bcb7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.399500 Sep 13 19:58:17.592191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 738/1477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:17.700311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:17.700944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:17.707947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.708437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.708872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.709556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.710091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.710521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.777022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:17.785658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2c37c00e-86b0-4907-a76f-b2f7931936b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089194 Sep 13 19:58:17.786224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 740/1478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:17.851812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:17.853921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:17.860534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.861014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.861445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.862153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.862593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.863033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.893258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fa229d16-5472-49c6-aa15-a9c1a6851102 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Sep 13 19:58:17.893854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 739/1479] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:17 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:17.904303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:17.906457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:17.912792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.913268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.913729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.914409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:17.914849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:17.915265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:17.945377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-31099e79-44fe-45fa-bbe5-e253877cd13a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045383 Sep 13 19:58:17.945967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 741/1480] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:18.616525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.617127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:18.623170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.623649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.624079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.624789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.625235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.626319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.754602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:18.762388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aad08490-1b30-4474-90f4-d06d70d4c9e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.149992 Sep 13 19:58:18.763868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 740/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:18.808103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.808712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:18.815178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.815651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.816081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.816763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.817210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.817644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.882329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:18.890117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-61e3283e-55b5-422a-995b-da509fbfb08e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085820 Sep 13 19:58:18.890681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 742/1482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:18.905970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.908584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:18.914826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.915306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.915738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.916427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.916870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.917283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.946352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-448692fd-aee4-4732-8321-4f41029d5979 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Sep 13 19:58:18.946896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 741/1483] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:18 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:18.957931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:18.960089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:18.966040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.966522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.966964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.967650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:18.968098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:18.968522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:18.998536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4ecf2b69-35bb-43b6-8908-3bced9501659 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 13 19:58:18.999095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 743/1484] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:19.787336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:19.787933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:19.794251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:19.794726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:19.795152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:19.795828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:19.796270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:19.796684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:19.922342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:19.922967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:19.929372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:19.929897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:19.930326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:19.931015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:19.931460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:19.931886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:19.935715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:19.943515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-05335c1b-1e7c-4ac0-b019-9c5a03f3843f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.160208 Sep 13 19:58:19.944100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 742/1485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:19.959354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:19.961868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:19.970008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:19.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:19.971131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:19.972316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:19.972971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:19.973589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:20.003994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2991e942-42e8-4036-87eb-67bf7506b478 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048519 Sep 13 19:58:20.004165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:20.008858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 743/1486] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:19 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:20.012750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-afda980a-f173-42db-865e-6eb346411ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094830 Sep 13 19:58:20.013502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 744/1487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:20.013861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:20.016902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:20.022813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:20.023302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:20.023737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:20.024434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:20.024884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:20.025309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:20.056315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f325d32c-50d9-4e47-a982-90a81cfa4ab9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046282 Sep 13 19:58:20.056883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 744/1488] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:20.968027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:20.968661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:20.976299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:20.976700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:20.977130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:20.977854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:20.978298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:20.978714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.018056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:21.020412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:21.027347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:21.027838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:21.028278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.028988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:21.029432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:21.029941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.062960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-166eef17-0add-48a6-8054-50683541cbe6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048739 Sep 13 19:58:21.067934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 745/1489] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:21 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:21.068424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:21.069037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:21.075060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:21.075545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:21.075987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.076704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:21.077333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:21.078173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.163623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:21.171125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:21.171800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7f99dee0-3c01-4d14-8244-37efe1fcceef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106790 Sep 13 19:58:21.173100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 746/1490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:21.177599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:21.179851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:21.180569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ba32b8ee-1141-4510-a130-003a7debfe25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.216487 Sep 13 19:58:21.188407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 745/1491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:21.188606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:21.188606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:21.188606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.188606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:21.189053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:21.189053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:21.220222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f212c44-c090-440f-970e-01f252e6bb33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Sep 13 19:58:21.220796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 747/1492] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:22.076091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:22.078220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:22.085154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.085651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.086090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.086770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.087217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.087638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.118020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fb042595-dbfb-4dfe-9a72-f8101ec66619 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Sep 13 19:58:22.118579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 746/1493] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:22 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:22.197198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:22.197931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:22.204683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:22.205158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.205325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:22.205501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.205838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.206522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.206967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.207381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.211138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.211614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.212045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.212730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.213174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.213594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.293151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:22.301046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-11020c4a-81b1-4f77-b71a-acd1e150791e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110050 Sep 13 19:58:22.301632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 748/1494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:22.306186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:22.308356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:22.314582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.315056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.315486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.316169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.316604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.317015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.348621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c1876080-a17c-4735-a475-210973d04231 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045826 Sep 13 19:58:22.349103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 749/1495] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:22.369803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:22.378206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-90e69f10-bee3-4a76-a4d9-edb2e1650be5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.177887 Sep 13 19:58:22.378805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 747/1496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:23.130800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:23.132993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:23.139186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.139671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.140105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.141446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.142874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.142874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.168071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:23.173389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9b1947ab-a04a-4493-8789-9d014879f997 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Sep 13 19:58:23.173981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 750/1497] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:23 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:23.323857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:23.324416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:23.331439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.331916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.332346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.333088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.333537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.333988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.360989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:23.363153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:23.369632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.370131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.370559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.371252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.371712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.372126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.396367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:23.403750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d25f8041-896c-48f0-8309-58bb109dd087 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046720 Sep 13 19:58:23.404325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 751/1498] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:23.404772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4f26897e-f5c0-496b-83ef-24edfcc9f70d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084848 Sep 13 19:58:23.405335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 748/1499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:23.410201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:23.410915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:23.416958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.417431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.417895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.418576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:23.419021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:23.419611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:23.550985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:23.559495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-43d11186-8fbf-4788-a172-463d4d315e6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.154140 Sep 13 19:58:23.560076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 752/1500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:24.186231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:24.188469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:24.194963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.195486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.195930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.196640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.197095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.197521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.212486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:24.235549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d7d139a7-85e0-4e8e-8c4c-d55dcfea968d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052804 Sep 13 19:58:24.236170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 749/1501] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:24 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:24.416552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:24.418822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:24.425673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.426158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.426585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.426751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:24.427277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.427381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:24.427719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.428135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.433985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.434471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.434916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.435616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.436074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.436555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.459619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-113f4c36-66d8-41d3-adb9-7d436e49d4ef tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Sep 13 19:58:24.460193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 753/1502] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:24.500219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:24.508588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7cc64372-f9c3-4341-b1e2-9f4953a00937 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085645 Sep 13 19:58:24.509174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 750/1503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:24.584063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:24.584705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:24.590908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.591400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.591837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.592536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:24.592983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:24.593403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:24.737014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:24.745116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-48eb9794-ded2-48e5-889e-447eea962f50 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.164890 Sep 13 19:58:24.745711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 754/1504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:25.248643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:25.251459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:25.257564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.258078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.258506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.259198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.259640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.260058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.292321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fb895879-02cc-4d17-adc7-311520071897 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Sep 13 19:58:25.292822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 751/1505] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:25.472637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:25.474946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:25.481875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.482369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.482807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.483529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.483979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.484437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.519450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-37f7e0ab-9d98-4118-8ffe-1653d1eba592 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051543 Sep 13 19:58:25.519891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 755/1506] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:25.532512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:25.533280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:25.540928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.541440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.542012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.542805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.543347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.543784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.608153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:25.617235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9008b270-c9b3-4233-a312-370ead1150cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089151 Sep 13 19:58:25.617860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 752/1507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:25.770305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:25.771089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:25.778020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.778500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.778922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.779605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:25.780045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:25.780457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:25.922525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:25.930558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8b3aac9f-d418-49a9-addf-1a4fabe8a9ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.164784 Sep 13 19:58:25.931137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 756/1508] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:26.305808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:26.308134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:26.314915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.315398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.315837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.316528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.316975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.317395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.349136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-95e56469-39a5-47a9-a12c-c854943b476d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047451 Sep 13 19:58:26.349719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 753/1509] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:26 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:26.532006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:26.534208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:26.541309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.541839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.542259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.542949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.543390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.543805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.575625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6c53f259-adf9-4ef5-8a62-1627d602714e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Sep 13 19:58:26.576114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 757/1510] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:26.640392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:26.641515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:26.648214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.648694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.649128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.649888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.650331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.650750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.713572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:26.722451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-212a478c-d939-4505-95fc-3227b0542a79 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085820 Sep 13 19:58:26.723040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 754/1511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:26.953977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:26.959817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:26.961820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.961820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.962755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:26.963780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:26.964249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:26.964691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.120579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:27.130536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9e891e8e-8605-4f74-9557-fc90ac43859a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.181054 Sep 13 19:58:27.131137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 758/1512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:27.362391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:27.364638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:27.370885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:27.371368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:27.371802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.372559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:27.373004 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:27.373422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.409407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5d728998-51be-4b18-b5c2-dc4da7beea56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051505 Sep 13 19:58:27.410044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 755/1513] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:27 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:27.587849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:27.590265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:27.597005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:27.597519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:27.597989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.598691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:27.599145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:27.599576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.635260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-13d45d32-44dd-4dd6-926c-412f312e9c7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050924 Sep 13 19:58:27.636222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 759/1514] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:27.745075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:27.745707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:27.752146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:27.752629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:27.753067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.753790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:27.754241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:27.754665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:27.822894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:27.831519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0721f554-50a5-458e-a78a-ebddac48d953 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090216 Sep 13 19:58:27.832121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 756/1515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:28.156951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:28.157582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:28.165931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.166513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.167168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.169150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.169150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.169444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.307682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:28.315950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-90742c6c-86fc-4165-ae67-ae6d59a41cd1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.163419 Sep 13 19:58:28.316527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 760/1516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:28.423066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:28.425555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:28.435107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.435597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.436031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.436832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.437907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.438316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.481189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-020a129d-25e0-43dc-bcc8-9610344cd6e6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062046 Sep 13 19:58:28.481947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 757/1517] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:28 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:28.649949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:28.652551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:28.659616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.660106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.660543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.661510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.661993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.662415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.694972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9083bd6f-09ca-4e2b-ae6d-36d7fa1cbca1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050026 Sep 13 19:58:28.695555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 761/1518] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:28.855122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:28.855734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:28.863915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.864962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.865448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.866303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:28.867237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:28.867665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:28.932402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:28.941030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a2b1abb5-30fb-4d28-8ac7-da5e37c82b5b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089819 Sep 13 19:58:28.941602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 758/1519] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:29.340287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:29.340804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:29.347738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.348220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.348717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.349424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.349911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.350339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.490173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:29.496190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:29.498468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f6cec36b-d7fd-4842-a4ba-45d79634d9df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.162098 Sep 13 19:58:29.498941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:29.499132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 762/1520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:29.506309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.506952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.507589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.508388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.508935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.509452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.541145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a3259ab3-0386-43d5-a1cd-4101685805ba tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050269 Sep 13 19:58:29.541736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 759/1521] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:29 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:29.708588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:29.710766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:29.717325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.717846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.718283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.719506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.719950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.720371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.752174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-26e4ca3c-3ab0-4b69-8a01-33b82568d9e8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047366 Sep 13 19:58:29.752929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 763/1522] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:29.964062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:29.964727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:29.971574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.972072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.972517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:29.973465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:29.973951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:29.974386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.041104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:30.049082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5aa46dce-9200-4295-bebd-7406cd71b13c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089222 Sep 13 19:58:30.049684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 760/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:30.522332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:30.522939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:30.529135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:30.529712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:30.530095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.530803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:30.531260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:30.531680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.555819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:30.560701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:30.565334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:30.565829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:30.567507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.567507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:30.567507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:30.569101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.602816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7bc2abb4-f88a-4142-a580-111c985e3228 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052069 Sep 13 19:58:30.603412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 761/1524] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:30 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:30.689568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:30.699181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b5f049a0-ae35-46b7-85ca-d470efe22ac3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.180598 Sep 13 19:58:30.699851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 764/1525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:30.765434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:30.767649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:30.773962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:30.774373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:30.774807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.775500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:30.775949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:30.776373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:30.809136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-119954aa-e56d-4e9a-9036-d6784e6ddc39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Sep 13 19:58:30.809739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 762/1526] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:31.072670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:31.073310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:31.079827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.080301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.080724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.081399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.081863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.082279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.160428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:31.170806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a7f0b88e-e31f-485d-b97b-924fd9d80f01 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101995 Sep 13 19:58:31.171405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 765/1527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:31.617347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:31.619512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:31.626704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.627182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.627609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.628292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.628734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.629259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.658393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e67b29d2-c4bb-4e44-900e-53b904e1315b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Sep 13 19:58:31.658952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 763/1528] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:31 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:31.722982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:31.723606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:31.730172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.730658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.731093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.731805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.732250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.732668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.826252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:31.829162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:31.837329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.837899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.838915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.839636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:31.840089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:31.840506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:31.877359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e913fb26-21ec-4e00-a800-587183e69ff8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059456 Sep 13 19:58:31.878349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 764/1529] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:31.880324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:31.894111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e7ad3928-1d63-44f7-bfe5-745c4b64fe2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.174875 Sep 13 19:58:31.894953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 766/1530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:32.195141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:32.195708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:32.201661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.202133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.202559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.203731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.204170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.204583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.272873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:32.280489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-18bd23bd-c75a-48f1-beac-f6b2cb3a9649 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089558 Sep 13 19:58:32.281633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 765/1531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:32.671187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:32.673999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:32.680442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.680938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.681366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.682064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.682503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.682918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.697771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:32.715659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-beec1981-62c7-42f9-99a0-bc8667a5b097 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048796 Sep 13 19:58:32.716215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 767/1532] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:32 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:32.890261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:32.893114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:32.899863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.900347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.900783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.901474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.901953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.902374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.904910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:32.924087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:32.924482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:32.930604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.931093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.931578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.932288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:32.932741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:32.933163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:32.940821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-60da18c9-51e4-4a62-9757-5ecf98885bd7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054768 Sep 13 19:58:32.941650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 766/1533] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:33.075474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:33.084294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fb2b5a3e-29d4-4d64-a0ab-eb569e1d4a56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165635 Sep 13 19:58:33.084878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 768/1534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:33.304051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:33.304567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:33.312823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.313302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.313762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.314453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.314892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.315304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.381238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:33.389168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d2a4fffc-0a93-411a-9625-cf600b070bd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089023 Sep 13 19:58:33.389766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 767/1535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:33.729699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:33.732754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:33.741201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.741984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.742582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.743629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.744227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.744793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.779320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aacc3c89-17ef-442c-a96c-1bc79da7a37d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054788 Sep 13 19:58:33.780066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 769/1536] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:33 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:33.953744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:33.956006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:33.962614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.963182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.963620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.964320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.964772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.965200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.996750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-693a7ef8-40cf-4c6c-9b4f-357bf6d3ef00 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047080 Sep 13 19:58:33.997241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 768/1537] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:34.108522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:34.109738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:34.115952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.116443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.116864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.117555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.118035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.118449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.257820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:34.267747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-669fc839-784c-4098-8861-e603c3468ccf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.163069 Sep 13 19:58:34.268472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 770/1538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:34.414478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:34.415096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:34.421226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.422258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.422700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.423391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.423834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.424255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.494097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:34.508626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4bb1cfe9-f02c-4be3-bf65-2e93db173046 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098503 Sep 13 19:58:34.509218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 769/1539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:34.793831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:34.795912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:34.803743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.804252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.804678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.805360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.805829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.806248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.842324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fddd6ad2-db40-45c9-b83a-f401a790c8e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053657 Sep 13 19:58:34.842890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 771/1540] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:34 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:35.012259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.014469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:35.022867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.023368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.023807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.024515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.024965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.025392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.060570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1af09dac-0f56-49ef-a944-d117bae40584 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052254 Sep 13 19:58:35.061060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 770/1541] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:35 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:35.297665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.298285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:35.304612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.305095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.305527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.306247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.306695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.307114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.470640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:35.479539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6e7fb51c-15b8-468f-88ce-0300d313a0d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.186419 Sep 13 19:58:35.480134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 772/1542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:35.534393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.534994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:35.543381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.544123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.544780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.546111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.546692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.547249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.627956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:35.636102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-531463c5-dd60-4e34-b91d-a9fb94c81acc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.107086 Sep 13 19:58:35.636629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 771/1543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:35.856744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.859009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:35.865630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.866140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.866574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.867263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.867706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.868125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.900196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fcb243d9-8712-48d7-afd2-e2cc8a226322 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Sep 13 19:58:35.900760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 773/1544] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:35 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:36.074387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:36.076574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:36.083309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.083719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.084151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.084843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.085292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.085811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.118161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-39f3aad9-0df2-4576-9f5f-3757de406f59 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047446 Sep 13 19:58:36.118651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 772/1545] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:36.505914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:36.506528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:36.512898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.513385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.513853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.514555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.515012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.515431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.660526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:36.661787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:36.668432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:36.670683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.671503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.672216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.673363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.673976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.674659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.681698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-94037455-dfdb-4323-b3a5-9a7292a38cda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.179345 Sep 13 19:58:36.682461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 774/1546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:36.747986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:36.757190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-53b433f4-cab9-4f93-98a3-972b985b96c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101495 Sep 13 19:58:36.757721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 773/1547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:36.913634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:36.915822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:36.925019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.925580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.926221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.926943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:36.927389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:36.927806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.968543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-339ce0db-d0d3-4743-aa79-cd84d94d3790 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058985 Sep 13 19:58:36.969110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 775/1548] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:36 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:37.132086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:37.134414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:37.141446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.142032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.142469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.143295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.143743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.144166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.175804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f611fe8e-82d4-45e6-8170-f43c803098ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047913 Sep 13 19:58:37.176380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 774/1549] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:37.705943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:37.706566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:37.712890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.713373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.713837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.714608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.715071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.715484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.781588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:37.782221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:37.784137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:37.789785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.790275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.790717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.791424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.791879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.792308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.868072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:37.876936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0d0b2206-0124-4e62-83d7-d260c1b3dcb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099736 Sep 13 19:58:37.877551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 775/1550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:37.881861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:37.889915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-951f03d1-c5a1-4527-9e62-07d621f903ee tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.188396 Sep 13 19:58:37.891054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 776/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:37.981783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:37.983910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:37.990265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.990746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.991182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.991882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.992334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.992754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.027105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7cd477db-3b4e-4905-b655-25cff82386af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049641 Sep 13 19:58:38.027688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 776/1552] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:38.189077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:38.191239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:38.193585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:38.199049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.199529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.199964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.200656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.201099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.201520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.232742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-22be470f-9eb2-4d04-a3bd-e4c45daf839d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Sep 13 19:58:38.233226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 777/1553] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:38.902355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:38.903263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:38.913150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.913875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.914472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.914820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:38.915318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.915423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:38.915999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.916605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.922650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.923137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.923610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.924306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.924753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.925168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.005209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:39.014678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c95a86bc-559f-48ce-ad30-e4ca19868101 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117684 Sep 13 19:58:39.025708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 777/1554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:39.040798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.043136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:39.050343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.050887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.051241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.051973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.052382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.052801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.086985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1f214447-a96d-4aa9-9773-7b7a0a6bf318 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050161 Sep 13 19:58:39.087576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 778/1555] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:39 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:39.107357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:39.115992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-34978586-8a5a-403d-8a06-eef94f5a148e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.205646 Sep 13 19:58:39.116583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 778/1556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:39.244756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.247126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:39.253850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.254399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.254843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.255593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.256044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.256485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.291781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-da31afc5-8775-4402-98c4-b28ba0a26d4d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050932 Sep 13 19:58:39.292397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 779/1557] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:40.040783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:40.041391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:40.048745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.049245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.049706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.050409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.050863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.051293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.101141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:40.103281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:40.110890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.111384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.111836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.112552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.113250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.113731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.119401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:40.127822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5cd5cd8b-f6bc-4e72-b146-cda5e2cfed1d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090797 Sep 13 19:58:40.128418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 779/1558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:40.141908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:40.143420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:40.149111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.149597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.150048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.150758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.151390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.151812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.164808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b48947e1-4fd1-4652-970b-be3e50796bfe tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067128 Sep 13 19:58:40.166433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 780/1559] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:40.306933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:40.309300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:40.316354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:40.316656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.317112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.317619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.318400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.318925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.319382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.328331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3b68f399-69ed-4b0a-93ed-a536c7c52c42 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.190648 Sep 13 19:58:40.329088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 780/1560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:40.356510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-af7308a8-d523-4970-bf3e-93996f685547 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054165 Sep 13 19:58:40.357129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 781/1561] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:41.150801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.151424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:41.158679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.159776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.160469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.161567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.162065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.162491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.183918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.186804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:41.193826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.194333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.194812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.195513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.195956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.196378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.225796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:41.234147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ce01bfff-bf9c-4ed5-857d-e2aac2512f9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056681 Sep 13 19:58:41.234765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 782/1562] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:41 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:41.238173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:41.246706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-04c5a999-3256-4c41-85ed-e4a019b410c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099666 Sep 13 19:58:41.247303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 781/1563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:41.352946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.353485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:41.360489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.361014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.361459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.362196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.362652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.363358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.371080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.374956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:41.384334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.385092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.385847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.386949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.387659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.388324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.426060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9090fcb7-ee78-4e72-a925-ad1dbbe16558 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061210 Sep 13 19:58:41.426712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 782/1564] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:41.522883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:41.533461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-49e10524-2f41-4c5a-b297-4965f6a6104b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.184753 Sep 13 19:58:41.534127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 783/1565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:42.248476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:42.250783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:42.257477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.258007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.258453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.259160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.259608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.260036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.272019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:42.272647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:42.279752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.281547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.282703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.282882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.283305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.283746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.299280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a67efe47-63cb-4768-b5bc-0dc278565ed6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055354 Sep 13 19:58:42.299906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 783/1566] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:42.362395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:42.371125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-946fc91a-26e5-4705-a362-771a9d44e311 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102880 Sep 13 19:58:42.371722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 784/1567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:42.440460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:42.442692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:42.449118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.449642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.450099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.450824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.451285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.451717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.454709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:42.486127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a1068c3f-807c-4349-be1f-b02476583f8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050082 Sep 13 19:58:42.486714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 784/1568] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:42.561020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:42.562061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:42.568628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.569334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.569913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.570674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:42.571223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:42.571687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:42.723767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:42.734049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-be8cc2d9-4400-4b38-a436-5ceb381d2db1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.176491 Sep 13 19:58:42.734712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 785/1569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:43.311830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.313992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:43.320734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.321224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.321685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.322394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.322840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.323256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.365341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-53c96b7f-fa83-44bb-ae86-4fe007ce49c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057220 Sep 13 19:58:43.366340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 785/1570] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:43.395565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.396295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:43.406175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.407161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.407161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.407838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.408312 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.408721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.481618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:43.490389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a90cc611-0f93-45b3-a922-9da32589e2ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098851 Sep 13 19:58:43.490979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 786/1571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:43.499857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.502263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:43.509492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.510008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.510445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.511208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.511726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.512146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.548061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fd529fbc-4fa2-43fc-8bc4-a790ae0369cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052329 Sep 13 19:58:43.548645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 786/1572] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:43.758057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.758656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:43.764856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.765335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.765799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.766499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.766940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.767384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.927918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:43.937423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-28d6efca-4749-4380-99ab-a30218ba4ea5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.182986 Sep 13 19:58:43.938575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 787/1573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:44.378909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.381108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:44.387761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.388239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.388696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.389378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.390357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.390770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.425881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d2f0789e-872a-4a7d-b4f7-a9f2c58e2b62 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051064 Sep 13 19:58:44.426500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 787/1574] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:44.513863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.514468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:44.523574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.524057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.524489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.525178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.525637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.526065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.560963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.563646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:44.569785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.570276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.570713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.571410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.571862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.572341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.590394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:44.598403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-195940f2-2ab1-42fe-8812-68c341087c52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089014 Sep 13 19:58:44.599273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 788/1575] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:44.604089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6293bdb9-c26b-4aca-aead-fae086f53c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Sep 13 19:58:44.604732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 788/1576] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:44.962424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.963038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:44.969086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.969568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.970037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.970728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.971184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.971608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.109113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:45.117323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-07fb5eda-d03c-4bc3-9ca0-171ab73e3931 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.158624 Sep 13 19:58:45.118119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 789/1577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:45.439240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:45.441442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:45.448153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.448730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.449239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.450035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.450532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.450989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.485029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b7aaa55b-43e9-47d2-8493-0a511c56be4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050405 Sep 13 19:58:45.485636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 789/1578] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:45.619323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:45.620268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:45.620759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:45.621101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:45.628421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.629167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.629548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.629836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.630139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.630623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.630812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.631352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.631551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.631996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.632232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.632457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.672298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-044b61df-0b78-4bec-aa8f-dfabaee8e552 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059369 Sep 13 19:58:45.672878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 790/1579] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:45.713326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:45.721738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-24a754d1-9474-405e-926c-56d0c25b74f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105309 Sep 13 19:58:45.722327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 790/1580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:46.143287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:46.143906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:46.151133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.151635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.152063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.152734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.153249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.153695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.326156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:46.334586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-79ea2df4-7be6-4b24-a0ad-c34e78d20948 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.195538 Sep 13 19:58:46.335260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 791/1581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:46.499730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:46.503650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:46.512722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.513211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.513673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.514884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.515359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.515785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.550166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7c966793-fd19-4094-aefa-6f43db7fb449 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056170 Sep 13 19:58:46.550746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 791/1582] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:46 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:46.685280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:46.687523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:46.694218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.694755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.695151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.695856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.696304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.696727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.737717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a864b2be-a6a5-4694-a279-794d261675a7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056832 Sep 13 19:58:46.738370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 792/1583] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:46.747266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:46.747876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:46.754350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.754909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.755265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.756074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.756519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.756941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.835084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:46.842622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d9d5dea6-f47f-4db7-8a35-3b674e3699ba tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101248 Sep 13 19:58:46.843206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 792/1584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:47.361730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:47.362529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:47.368816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.369300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.369762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.370465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.370913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.371376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.529845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:47.539166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a80298d2-9b2c-45b6-acf8-8fe2229bcfa0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.183206 Sep 13 19:58:47.539655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 793/1585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:47.563845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:47.566094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:47.573463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.574166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.574607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.575303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.575756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.576176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.611352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-39f7389a-9b9f-4380-9cbd-8d5e9519e5dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052103 Sep 13 19:58:47.611928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 793/1586] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:47 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:47.754016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:47.756244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:47.762783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.763270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.763709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.764474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.765454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.765919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.801759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f24ec5df-2ab4-409e-a5c0-572239c0c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052510 Sep 13 19:58:47.802236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 794/1587] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:47.865536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:47.866182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:47.877565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.878087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.879182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.879920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:47.880397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:47.880836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:47.949225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:47.957094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0a325dae-952d-44b5-9f03-d2b23ef5eca3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095417 Sep 13 19:58:47.957707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 794/1588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:48.562857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:48.563464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:48.569721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.570205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.570644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.571343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.571784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.572205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.624865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:48.627177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:48.633592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.634142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.634578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.635417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.635878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.636300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.668811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-70947797-0564-4955-8fea-bc6e782aaa3e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048764 Sep 13 19:58:48.669389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 795/1589] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:48.709139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:48.716936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-51b0baa9-a455-4868-aaa3-1d51581372eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.158053 Sep 13 19:58:48.717632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 795/1590] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:48.815898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:48.818012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:48.824067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.824543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.824979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.825714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.826170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.826591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.858187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c243efbd-1e50-4fc2-a068-d922c9a48179 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046277 Sep 13 19:58:48.858622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 796/1591] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:48.980446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:48.981046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:48.987555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.988036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.988471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.989158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.989634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.990057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.057357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:49.066102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-13f336c1-7f18-4b26-b297-67c4573b5429 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089558 Sep 13 19:58:49.066587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 796/1592] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:49.683956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:49.687322 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:49.697195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.697699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.699400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.699400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.699400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.699731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.730819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6d954f76-6844-4048-bd89-a1a42b9c9f86 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052247 Sep 13 19:58:49.731211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 797/1593] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:49.740259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:49.741671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:49.747017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.747502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.747938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.748641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.749088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.749509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.871003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:49.873251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:49.881275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.881819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.882266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.882983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:49.883960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:49.883960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:49.896511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:49.904476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aa8011e6-ab6b-4668-9153-823dcada6655 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.167927 Sep 13 19:58:49.905671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 797/1594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:49.922643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5b781bd2-f996-4837-9499-037ff0521550 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055582 Sep 13 19:58:49.923399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 798/1595] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:50.089642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:50.090279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:50.097808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.098332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.098784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.099528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.100009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.100438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.170000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:50.180310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-950f48f2-a9fa-4039-921c-f63e1d6f3e6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095063 Sep 13 19:58:50.180898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 798/1596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:50.743695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:50.745884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:50.752577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.753059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.753494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.754237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.754717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.755138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.785265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8dd9fbd4-fd23-46fd-abf4-da46a616a86f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Sep 13 19:58:50.786116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 799/1597] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:50.928207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:50.928809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:50.934903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.935376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.935802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.936391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:50.936522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.936910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.937329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.938621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:50.944713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.945199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.946831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.946831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:50.946831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:50.947212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:50.953701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:50.986869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:50.994140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fc5b9d06-894f-488e-83a5-311bca0d90a8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061671 Sep 13 19:58:50.994647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 800/1598] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:51.092184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.101485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bf641e60-9010-410e-98af-893cb44f2493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.176988 Sep 13 19:58:51.102091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 799/1599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:51.204425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:51.205113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:51.212692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.213205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.213663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.214372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.214859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.215305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.299834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:51.313053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2c2979ad-3e0f-46a9-af5d-1a8237ed1df9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112950 Sep 13 19:58:51.314188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 801/1600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:51.799228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:51.801711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:51.810238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.811108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.812359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.813476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:51.814298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:51.814968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:51.855688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f02ba71a-1657-49ac-8c9a-abbae185bf45 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060971 Sep 13 19:58:51.856295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 800/1601] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:51 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:52.006162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:52.008327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:52.014974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.015458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.015892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.016597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.017044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.017460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.051636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3b37f3d6-f13f-4146-9079-eed735dc3449 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049328 Sep 13 19:58:52.052130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 802/1602] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:52.124841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:52.125462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:52.131990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.132463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.132892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.133571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.134043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.134459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.282341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:52.290902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e428b3d9-a2e6-4080-8649-9a42175cf3d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.169900 Sep 13 19:58:52.291497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 801/1603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:52.348685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:52.349191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:52.355697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.356179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.356619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.357388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.358660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.359295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.431375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:52.439449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1d392b11-29ba-41b8-b89f-82c0e411c6f9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094791 Sep 13 19:58:52.440038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 803/1604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:52.871710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:52.875744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:52.885256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.886096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.886546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.887475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:52.888191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:52.888911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:52.926006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cf4b9803-d235-43af-b3ff-b78dbe7ccc2b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060998 Sep 13 19:58:52.926786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 802/1605] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:53.068062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.071112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.081329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.082231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.082987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.084264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.085075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.085901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.122044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8de59c8f-21cc-407f-944e-65b1561b24b9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061287 Sep 13 19:58:53.122510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 804/1606] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:53.315855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.316616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.323499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.324010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.324436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.325118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.325566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.326024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.464759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.465829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.472777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.473393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.474058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.474926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.475540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.476067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.493309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.506521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-45d87887-6af7-4800-bd78-b125fe327cbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.194978 Sep 13 19:58:53.508232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 803/1607] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:53.555021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:53.564072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f4ce6566-5dbd-4046-b359-e30ccf48b8f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104420 Sep 13 19:58:53.564726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 805/1608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:53.945273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:53.947424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:53.958579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.959440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.960204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:53.961422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:53.962256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:53.962999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.018874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-38d1912b-0236-49a3-8341-02d67c5c505d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082269 Sep 13 19:58:54.019762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 804/1609] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:54.138679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:54.142542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:54.152849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.153739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.154532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.156542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.157288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.158099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.215684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f246501f-95ba-477c-8ae1-c906d14c2f11 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083126 Sep 13 19:58:54.216703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 806/1610] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:54.535021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:54.536265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:54.547266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.548107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.548771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.549978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.550783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.551524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.603530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:54.604732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:54.615907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.617220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.618031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.619277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:54.620058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:54.620782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:54.720741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:54.734887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0672baed-6123-41c8-939c-173995a30cf9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.137937 Sep 13 19:58:54.735654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 807/1611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:54.759044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:54.767363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d4636ff9-623f-447c-9765-4566fd7b2b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.239715 Sep 13 19:58:54.768025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 805/1612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:55.033634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:55.036099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:55.042667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.043155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.043588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.044292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.044736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.045157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.085206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-95eb1e33-0f3b-481a-8611-4e0dcb81070d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055857 Sep 13 19:58:55.085943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 808/1613] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:55.232634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:55.235428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:55.241928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.242414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.242851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.243546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.243988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.244402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.277838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9880688a-a509-423b-bc6b-4c6f83612c05 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049211 Sep 13 19:58:55.278391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 806/1614] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:55.772231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:55.772888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:55.781369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.781897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.782340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.783119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.783696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.784133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.798622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:55.799621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:55.808045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.808679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.809335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.810358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:55.811520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:55.812052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:55.878683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:55.888173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63a0da70-3480-4f72-809e-1809b762b36a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.119597 Sep 13 19:58:55.888879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 809/1615] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:56.008788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:56.021702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0dcf1621-59a1-4d3d-9a20-25967ed8ef93 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.227480 Sep 13 19:58:56.022463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 807/1616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:56.099536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:56.101707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:56.107985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.108466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.108902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.109629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.110076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.110498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.148538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-69d22ce8-81e6-4a40-b7aa-25e690bdbd88 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052666 Sep 13 19:58:56.149590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 810/1617] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:56 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:56.297005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:56.300589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:56.311510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.312378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.313143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.314415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.315220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.315964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.363465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6d73844b-9b91-493c-90d7-976c901c7b39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074536 Sep 13 19:58:56.364044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 808/1618] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:56.913454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:56.914167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:56.921499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.922075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.922558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:56.923317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:56.923817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:56.924330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.001922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:57.016026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-453174df-2484-4511-82e7-acbef76889b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.107227 Sep 13 19:58:57.016947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 811/1619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:57.049640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:57.050773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:57.063181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.064118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.064914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.066209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.067027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.067834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.166956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:57.169484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:57.179159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.180034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.180826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.182013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.182723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.183480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.226315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6577418a-5220-4093-81b4-9417496e58e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065553 Sep 13 19:58:57.226913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 812/1620] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:57 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:57.302405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:57.316860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-97168f99-15f1-4ca7-bd7a-08317e42cffa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.274366 Sep 13 19:58:57.317916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 809/1621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:57.383970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:57.387555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:57.399069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.399940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.400697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.402027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:57.402876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:57.403619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:57.458169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-629ac4e4-c725-42c6-835f-b5627b167783 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081592 Sep 13 19:58:57.458742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 813/1622] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:58.040635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:58.041457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:58.048837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.049503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.050070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.051166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.051726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.052248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.127718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:58.136962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9057e968-4e57-417c-be31-99a884f96224 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100399 Sep 13 19:58:58.137596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 810/1623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:58.244715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:58.248543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:58.260171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.261037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.261798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.263031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.263903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.264692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.323858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f62475fc-5585-4a7e-9c7a-546ce7b0df70 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086190 Sep 13 19:58:58.324832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 814/1624] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:58 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:58.360762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:58.362128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:58.372911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.374447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.375262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.376734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.377564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.378367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.479410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:58.484340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:58.502594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.503460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.504466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.506000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:58.506827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:58.507796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:58.565965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-695309ef-fc1c-41ce-9ddd-f54e28709e04 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094318 Sep 13 19:58:58.567018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 815/1625] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:58.624068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:58.636130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d5526de6-6fda-4afd-992f-2fb68e9d0f4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.283104 Sep 13 19:58:58.637121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 811/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:59.174083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:59.175056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:59.184450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.185160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.185962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.187102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.187817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.188490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.344920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:59.348587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:59.360697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.361564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.362372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.363612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.364788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.365158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.367750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.380620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e72c76c5-3290-40ab-b6b1-1a9b6e41a0c4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.212672 Sep 13 19:58:59.381657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 816/1627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:59.426052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a0d16d1d-a97f-4f03-91fd-7522acca78ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088280 Sep 13 19:58:59.427052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 812/1628] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:59 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:59.586100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:59.589581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:59.599529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.600368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.601084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.602335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.603348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.604095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.630252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:59.655335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d19b1afa-45cd-4700-893a-2f48d3e78073 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076105 Sep 13 19:58:59.655971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 817/1629] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:58:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:59.678291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:59.679346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:59.690252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.691098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.691857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.693094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:59.693926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:59.694686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:59.922411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:59.934037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5d9fdc1c-69e4-4db5-8ff7-36809fd2f974 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.262976 Sep 13 19:58:59.934626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 813/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:00.415346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.416424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.425077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.425647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.426125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.426860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.427364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.427867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.446429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.450077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.461182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.462061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.462815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.464023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.464814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.465552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.514529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:00.520009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cbf2082f-94ad-48ce-9bae-a9e294bcb664 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081198 Sep 13 19:59:00.521053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 814/1631] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:00.528511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-80c35e79-9609-4fab-a08a-36457e75e68a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117681 Sep 13 19:59:00.529951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 818/1632] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:00.676054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.679548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.689594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.690465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.691229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.692442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.693236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.694017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.745899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-18eea731-6774-4ba0-a100-99bb20b9bf1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076852 Sep 13 19:59:00.746898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 815/1633] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:00.977210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:00.978224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:00.988701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.989544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.990353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:00.991591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:00.992409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:00.993179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.168545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:01.181112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-02c22ed5-1768-4899-80f7-fda4abcbc097 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.211035 Sep 13 19:59:01.182100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 819/1634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:01.539208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:01.547830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:01.554977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.555574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.555899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.556605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.557058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.557493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.563799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:01.568348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:01.569476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:01.580534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.581454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.582285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.583550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.584423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.585284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.615663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8837b9f1-1616-4784-bf64-6d6194dbb23b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084003 Sep 13 19:59:01.616644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 816/1635] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:01 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:01.689887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:01.702943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-87113aa6-a5ee-47b3-ba4b-edcebd853402 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.141132 Sep 13 19:59:01.703836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 820/1636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:01.768318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:01.771971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:01.782863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.783392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.783838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.785013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:01.785914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:01.786352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:01.830743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-441c68bd-b634-4416-829d-370b5978736b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070049 Sep 13 19:59:01.831753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 817/1637] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:02.223743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:02.224828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:02.235505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.236332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.237084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.238303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.239106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.239867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.466704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.480987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0bf9a5c8-d34c-42fb-bd34-935076801ad0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.264136 Sep 13 19:59:02.481951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 821/1638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:02.634372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:02.637998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:02.649595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.650468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.651244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.652462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.653258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.654059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.711695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-36cf620e-223b-4b3b-a5cf-4e40310e5cfd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084356 Sep 13 19:59:02.712706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 818/1639] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:02 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:02.731090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:02.732096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:02.743786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.744628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.745381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.746624 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.747420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.748172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.851694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:02.854450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:02.855351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:02.866391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.867235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.867991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.869080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-be9287b9-e47d-42bf-a5f3-7ef4e9b84209 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.144880 Sep 13 19:59:02.869267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:02.870072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:02.870248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 822/1640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:02.870863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:02.919299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a618166a-4cb7-4bfd-968f-695167c4ed03 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074533 Sep 13 19:59:02.920328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 819/1641] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:03.521679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.522523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.533841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.534519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.535378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.536381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.537053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.537699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.705815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:03.714287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-78e53b08-99c3-4aea-b68b-056e9e2cc369 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.198424 Sep 13 19:59:03.714930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 823/1642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:03.731547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.735472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.745219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.746021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.746708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.747916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.749144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.749914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.798673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cfdc515b-6fdf-4ed9-b040-99c6eab1ff85 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073720 Sep 13 19:59:03.799347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 820/1643] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:03.899128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.900294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.907364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.907958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.908512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.909298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.909892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.910685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.940870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:03.944545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:03.954568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.955286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.956009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:03.957030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:03.957780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:03.958471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.004525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:04.015372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ca5024bd-8d61-425c-9402-e7e3e7f3ccb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082240 Sep 13 19:59:04.016674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 821/1644] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:04.020621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d21ff18c-28ac-4326-9754-194763b7bf6d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.123600 Sep 13 19:59:04.020842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 824/1645] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:04.744026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:04.745119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:04.757080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.757874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.758651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.759901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.760712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.761460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.816504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:04.820133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:04.823426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:59:04.823649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 19:59:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments (ip 10.222.0.23) !!! Sep 13 19:59:04.835281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.836127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.836879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.838152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:04.838971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:04.839750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:04.898741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0ff93e88-0db7-4df4-bcb5-7de7e96a6215 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089380 Sep 13 19:59:04.899753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 825/1646] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:04 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:04.988250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:05.002583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-89654c27-e508-4db9-bc7b-1e358611e18b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.265541 Sep 13 19:59:05.003579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 822/1647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:05.038138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:05.041819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:05.053136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.054044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.054814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.056051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.056851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.057633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.062482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:05.063489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:05.073005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.073808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.074544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.075697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.076511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.077233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.115292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29b6e922-e1ee-4334-bcc3-9c9fba093e33 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084397 Sep 13 19:59:05.116307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 826/1648] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:05.178007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:05.186268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-db4412ff-c1d5-48a3-bbda-4fca74037b97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.131413 Sep 13 19:59:05.186841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 823/1649] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:05.917412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:05.920146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:05.922059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:05.929581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.930158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.930598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.931290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:05.931730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:05.932144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:05.964693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a00ba688-cf76-4f86-8b7b-2ea9c8ad93d9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051753 Sep 13 19:59:05.965407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 827/1650] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:05 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:06.043416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:06.045065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:06.056040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.056898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.057708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.058921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.059710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.061162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.136427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:06.140063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:06.151279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.151859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.152503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.153566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.154124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.154648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.211963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-43a7ba6d-bfc5-4684-93e7-5567201ff4a5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082782 Sep 13 19:59:06.212953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 828/1651] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:06.226855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:06.228043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:06.239037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.239871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.240613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.241830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.242610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.243335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.297942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:06.312836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7526ae1e-dacd-4af3-8c65-5a64952595cd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.276300 Sep 13 19:59:06.313898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 824/1652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:06.356571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:06.369328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7efcc05f-2cb3-4ce9-9d05-6bde385df8b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.149799 Sep 13 19:59:06.370154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 829/1653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:06.980564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:06.984518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:06.987382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:06.996655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:06.997423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:06.998766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:06.999934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.000695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.001340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.054688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b93df36c-4120-4f90-bdb3-f35bdb12182d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081007 Sep 13 19:59:07.055787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 825/1654] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:06 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:07.232544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:07.235991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:07.246579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.247384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.248633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.250027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.250770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.251494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.305259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0bf21e43-77e3-4933-8d7b-63bef1a92c90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079405 Sep 13 19:59:07.306501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 830/1655] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:07.348739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:07.349831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:07.359540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.360324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.361037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.362222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.362978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.363672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.403904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:07.404597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:07.413278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.413278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.413278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.413278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:07.415084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:07.415084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:07.560535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:07.574419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ccd197f8-43b3-4d16-8276-812a60421f37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.174018 Sep 13 19:59:07.576312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 831/1656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:07.737701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:07.753558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-60236cc5-0415-4e72-b8a5-c5075d82dd87 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.411155 Sep 13 19:59:07.755137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 826/1657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:08.074659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:08.077710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:08.088338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.089318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.090321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.092110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.092942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.093725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.129162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-86a6e4ca-00e6-4ac3-aeda-7180267c0b7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060704 Sep 13 19:59:08.129770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 832/1658] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:08 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:08.328850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:08.332486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:08.342118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.342614 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.343080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.343786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.344243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.344673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.379358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-708cc828-7a1b-436f-bf8b-03fe0b01de3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059330 Sep 13 19:59:08.380249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 827/1659] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:08.603350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:08.604287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:08.615863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.616732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.617510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.618770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.619581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.620526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.715784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:08.731204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1a6b176f-f344-452b-8da1-c96ddeddbe53 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.131295 Sep 13 19:59:08.733430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 833/1660] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:08.797453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:08.798712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:08.807565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.808418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.809194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:08.810474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:08.811321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:08.812093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.005094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.017822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a49007fb-5370-4243-ba00-1a41cf382694 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.227951 Sep 13 19:59:09.018693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 828/1661] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:09.148483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:09.152096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:09.160330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.160805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.161457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.162681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.163549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.165128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.170419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:09.221966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7c1504e0-bf9d-4f5b-b6f8-16e16ad1874a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080434 Sep 13 19:59:09.222981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 834/1662] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:09 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:09.395944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:09.399796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:09.412124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.412975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.413790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.415062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.415878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.416683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.457451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3fec11ae-0e19-4922-996e-bc0a1aa072f8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067694 Sep 13 19:59:09.458160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 829/1663] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:09.771050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:09.771915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:09.778174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.778653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.779647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.780338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.780787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.781209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.863131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.873761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bd6a0853-ed4d-419e-97ec-59d653573c5e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106464 Sep 13 19:59:09.874477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 835/1664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:10.058162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.058866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.067952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.068576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.069304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.070405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.071034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.071730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.237701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.240265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.246953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.248262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.248885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.249821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.250340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.250874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.257382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:10.267333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c2ba6872-d362-4637-837a-2017747b627a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.214458 Sep 13 19:59:10.268033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 830/1665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:10.295992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9c14eb8c-4b02-4d90-b76f-ade4e2c17785 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062390 Sep 13 19:59:10.296456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 836/1666] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:10.474507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.478010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.489445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.490174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.490719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.491455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.491911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.492339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.542541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5992161a-655e-4e3a-bc1d-6df007b54f3a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074571 Sep 13 19:59:10.543593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 831/1667] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:10.902164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.903072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.912666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.913337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.913967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.914957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.915586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.916180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.014148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:11.028264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fc0d8e8b-9af9-43eb-894b-1f04a470f0f4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.131707 Sep 13 19:59:11.029882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 837/1668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:11.304309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:11.305320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:11.314857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.315152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:11.315690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.316460 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.317504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:11.317754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.318427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.319164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.328189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.329044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.329844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.331038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.331809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.332543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.384673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9d4db1bd-5031-4a02-980b-b029e20e978c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076428 Sep 13 19:59:11.385643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 838/1669] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:11 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:11.514709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:11.517058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:11.526902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8cc46760-a744-4731-b79f-76046101cfe6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.229671 Sep 13 19:59:11.527764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 832/1670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:11.667292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:11.671173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:11.679965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.680856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.681711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.682977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.683799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.684575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.730695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e0bd72ad-edf7-46f2-bc40-bd9216a143a9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176136 Sep 13 19:59:11.731263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 839/1671] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:12.065640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:12.066337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:12.072652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.073140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.073572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.074301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.074742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.075162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.165230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:12.179134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c0cb3a97-1e00-43b7-b8b6-7468fcc98846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116981 Sep 13 19:59:12.180174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 833/1672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:12.401768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:12.404658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:12.412545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.412978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.413449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.414221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.414730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.415186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.458235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-81dbdc91-96cc-4270-812c-86cb81d4adb7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060988 Sep 13 19:59:12.458804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 840/1673] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:12 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:12.562919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:12.563942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:12.571173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.571656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.572087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.572784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.573231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.573713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.746061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:12.748444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:12.755104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.757117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.757950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.758073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:12.759220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.760023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.760791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.768514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-88e8b624-2361-4bce-a78e-7e114a59c028 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.210550 Sep 13 19:59:12.769108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 834/1674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:12.806358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d8568cdb-330c-43a6-982b-f66f8583d36e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063948 Sep 13 19:59:12.807435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 841/1675] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:13.221065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.222212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.231655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.232246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.232733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.233415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.233920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.234339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.307367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.316592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-454d47eb-a87d-4c08-bb01-f0ac13e46504 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102397 Sep 13 19:59:13.317417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 835/1676] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:13.472114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.476249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.487421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.488224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.488896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.489938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.490696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.491357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.533956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fdf9d687-1beb-4da2-bb3c-4f1c2c0744c7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066379 Sep 13 19:59:13.534677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 842/1677] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:13.797457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.798394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.809276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.810714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.811503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.812678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.813489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.814274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.822735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.824994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.831958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.832489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.832892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.833596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.834075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.834657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.890106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-51e6afff-7e9d-440c-85a6-0895b7881df2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070820 Sep 13 19:59:13.891153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 843/1678] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:13.987141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.004977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-98158a4d-0bf1-4984-a654-be6c91ffef9c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.211781 Sep 13 19:59:14.006068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 836/1679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:14.344430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.345560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.354354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.354830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.355257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.355940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.356380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.357303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.426615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.439294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2bc965e1-b158-4f8f-af8e-d7f2fca2c194 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101949 Sep 13 19:59:14.440746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 844/1680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:14.549833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.553586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.563935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.564668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.565348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.566565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.567384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.568181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.620343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b7f6e379-5080-45d1-b8c4-f34bab688b49 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076482 Sep 13 19:59:14.621193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 837/1681] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:14.906581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.910270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.920635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.921115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.921551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.922275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.922924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.923342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.957045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-56052a83-8850-4a72-bd03-430a1c05aa93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056772 Sep 13 19:59:14.957630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 845/1682] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:15.040608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.041401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.049100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.049646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.050067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.050788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.051233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.051654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.228648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.245371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d643a47d-117e-4bdf-9fbe-40d9174432df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.208723 Sep 13 19:59:15.246006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 838/1683] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:15.467038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.468032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.478668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.479622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.480053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.481566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.482477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.483316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.553806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.562424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-64c168fc-ffce-46fe-8eba-9889963288c1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102648 Sep 13 19:59:15.563075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 846/1684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:15.638930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.643619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.649749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.650233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.650678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.651375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.651821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.652243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.683281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8c41a3de-af97-4faf-b72f-17de9c43b366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050423 Sep 13 19:59:15.683844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 839/1685] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:15.975355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.979026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.990593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.991106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.991581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.992297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.992747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.993170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.029669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-66a67901-1b86-4d4a-9ede-9ec8c67f680f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061837 Sep 13 19:59:16.030405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 847/1686] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:16.270663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.271407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.278098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.278747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.279401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.280205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.280692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.281293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.455392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:16.464697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-03865023-0dae-49d5-8066-4824e00b7427 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.198647 Sep 13 19:59:16.465276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 840/1687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:16.586612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.587711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.598890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.599767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.600622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.601901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.602698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.603385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.674185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:16.682491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e3647a34-d5e1-464c-a5c6-fcdee3954838 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100883 Sep 13 19:59:16.683061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 848/1688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:16.700868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.704210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.712730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.713548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.714336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.715505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.716641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.717212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.761877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b5f9fe94-2019-4ab9-80d0-7fccfc009642 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068679 Sep 13 19:59:16.762622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 841/1689] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:17.047170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.049795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.060888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.061786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.062613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.063969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.064769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.065511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.106946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d13ef021-e018-455e-a6e7-76d04eab939a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067438 Sep 13 19:59:17.107503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 849/1690] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:17.499752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.500841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.509192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.509809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.510441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.511327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.511868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.512507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.707484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.708205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.708948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:17.719723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.720590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.721368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.722686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.722933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9f5aacb6-ab3e-4558-9874-9f58a4b253b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.230160 Sep 13 19:59:17.723508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.724074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 842/1691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:17.724271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.779337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.783058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.794203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.795070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.795852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.797053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.797941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.798692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.804886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:17.807770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:17.816921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0566f817-5f0f-4471-a83e-edb04f93975f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.115276 Sep 13 19:59:17.817513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 850/1692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:17.833727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4f6ff686-8e1d-4e01-aa8e-33d0b962c52c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062273 Sep 13 19:59:17.834466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 843/1693] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:18.123577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:18.126904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:18.134034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.134523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.136085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.136601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.137083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.137518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.171344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8c55d51c-9266-4522-8c6d-d5d154f56a15 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054733 Sep 13 19:59:18.171925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 851/1694] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:18.749188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:18.750059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:18.757388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.757950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.758420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.759200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.759685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.760149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.845505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:18.846356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:18.854865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.855351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.855816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.857071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.857530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.857980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.934554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.948198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6f25a7ab-f902-427e-b5a6-9c89f1164f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109972 Sep 13 19:59:18.949197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 852/1695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:18.955460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:18.957689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:18.964748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.965526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.966321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.966517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.967524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:18.968080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:18.969034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.975262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-84187547-3116-4f97-9c56-5fc77a3b24bc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.231661 Sep 13 19:59:18.976164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 844/1696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:19.014534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0453320-723c-4695-bd4a-e51344d3f829 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063205 Sep 13 19:59:19.015120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 853/1697] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:18 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:19.191120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:19.194343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:19.203991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.204788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.205558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.206672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.207423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.208155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.251371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8bedcc5a-fea6-4207-9ca2-ca4214f0b67f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066425 Sep 13 19:59:19.252043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 845/1698] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:19.987229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:19.988101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:19.996678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.997192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.997656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.998466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.999094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.999776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.011026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.012911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.027287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.027635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.028963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.030220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.031017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.031763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.090672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.100068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0436f6d8-b662-48c4-8989-d1f44ba81563 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117999 Sep 13 19:59:20.100854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 854/1699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:20.109792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.110111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:59:20.110111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 19:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 19:59:20.114343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.126466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.127600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.128629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.130281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.131334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.132332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.172921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-565f3bf8-f068-47f9-901b-68b6580d87d4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070611 Sep 13 19:59:20.173554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 855/1700] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:20.232673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.244122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-59a7c683-4a30-4715-a919-17ff18e4b0cb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.239800 Sep 13 19:59:20.244731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 846/1701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:20.265175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.267563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.273765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.274244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.274670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.275359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.275804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.276221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.308963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-02069f02-8783-40dd-abce-5f96904f60c3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Sep 13 19:59:20.309597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 856/1702] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:21.145115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.146028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.154499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.155070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.155584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.156331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.156787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.157213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.246551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:21.256727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cc26a949-763f-48f8-8a2f-323b0699f26e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117197 Sep 13 19:59:21.257414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 847/1703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:21.270409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.275763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.280905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.281639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.288959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.289790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.290563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.290978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.291494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.291706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.291972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.292351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.293118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.293294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.293881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.294322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.341210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e825d50e-5ca0-438b-8700-3670df245366 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158397 Sep 13 19:59:21.342307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 857/1704] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:21.351335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.355224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.366299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.367175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.367955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.369209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.370062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.370836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.415976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-80e4050f-1673-4e21-aafb-92297ad796ff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072169 Sep 13 19:59:21.416972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 858/1705] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:21.464602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:21.475507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c510210a-62dc-4c3b-98ef-48d2c0bcb910 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.198871 Sep 13 19:59:21.476093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 848/1706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:22.298369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.298933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.300921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:59:22.301106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 19:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b (ip 10.222.0.23) !!! Sep 13 19:59:22.307779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.308274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.308684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.309920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.310361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.310779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.362077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.365733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.378095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.379141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.379981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.381218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.382072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.382839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.397328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.403204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:22.407985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-85435aff-0440-410f-a3b0-6b08df3510d7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.114808 Sep 13 19:59:22.408657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 859/1707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:22.424304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a92691fa-3807-4d54-b997-f2f1a0695190 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069071 Sep 13 19:59:22.424873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 849/1708] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:22.433671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.436002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.442907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.443546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.444093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.444820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.445305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.445814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.476979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-300a5b1b-a3bf-46cb-b64e-68833677ffc3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047532 Sep 13 19:59:22.477629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 860/1709] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:22.509989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.510608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.517371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.517971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.518412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.519114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.519563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.519989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.706882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:22.717600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4ffe5591-6128-4a84-a458-173bb29533cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.211751 Sep 13 19:59:22.718222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 850/1710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:23.436837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.437894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:23.440144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.443692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:23.448400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.449194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.450427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.451581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.452364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.453134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.454937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.455743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.456462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.457591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.458374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.459069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.500442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-17ecb100-31c6-4354-94e6-8c1ad70ac354 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066021 Sep 13 19:59:23.501499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 851/1711] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:23.509940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.514093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:23.522098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.522624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.523044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.523726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.524170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.524591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.545662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.557482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bf2a45bb-4800-431e-8f79-a1041a2d278b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.124820 Sep 13 19:59:23.558622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 861/1712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:23.574127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eab4d451-ae88-4f19-9372-3295c249fd8a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070735 Sep 13 19:59:23.575285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 852/1713] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:23.745319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:23.746333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:23.757954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.758951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.759749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.760822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:23.761878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:23.762742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.983421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.992842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fad51d05-0361-4934-a981-cacea2617c24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.254408 Sep 13 19:59:23.993913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 862/1714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:24.517116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.519463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.526551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.527081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.527560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.528826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.529310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.529900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.565917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-70d7010b-ec80-43be-b06e-5ed3ae26e767 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052774 Sep 13 19:59:24.566515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 853/1715] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:24.592942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.593839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.594695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.598774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.601114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.601628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.602733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.603450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.603901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.604336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.611421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.612306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.613100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.614424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.615275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.616021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.670595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3c6f691c-55e9-467e-aee3-1d8f2a368181 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083735 Sep 13 19:59:24.671529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 863/1716] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:24.685453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.700359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f5df9f1c-40ac-4935-9ce2-6c28f8407744 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110939 Sep 13 19:59:24.701390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 854/1717] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:25.020096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.021234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.029107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.029652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.030164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.030901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.031390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.031888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.206311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:25.220609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e8d2ddeb-e8b5-4bc3-8bf8-da4ca529e85e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.204806 Sep 13 19:59:25.221676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 864/1718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:25.583800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.585993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.593908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.594390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.594846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.595539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.596030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.596468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.631496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-03b7ec17-0fa8-4cbf-a1e1-5f2d92eaa98d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052203 Sep 13 19:59:25.632143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 855/1719] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:25.687010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.689236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.696568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.697067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.697853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.699013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.700192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.700917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.724979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.725641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.737001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.737938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.739426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.741042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.741836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.742848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.751431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-12fdc476-753a-439b-b707-73bac09b68d2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068711 Sep 13 19:59:25.752208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 865/1720] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:25.822490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:25.831630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-da4956f7-ca54-45bd-8b8e-2f277540c5ff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110465 Sep 13 19:59:25.832448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 856/1721] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:26.260802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.261914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.272891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.273388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.273907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.274667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.275137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.275626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.460899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:26.474196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f30d943e-894f-479e-90bc-09ef5d861f2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.219155 Sep 13 19:59:26.474876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 866/1722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:26.649409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.653455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.662273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.662795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.663258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.664181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.664403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.664833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.709174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-40be4da2-ae22-47dd-a351-78fceb21464f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066716 Sep 13 19:59:26.710251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 857/1723] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:26.768576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.770827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.777504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.778524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.778961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.779656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.780101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.780526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.795838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:26.815939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-401371e5-5960-4330-9cbc-f1b4eb4bde77 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Sep 13 19:59:26.816528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 867/1724] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:26.863392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.864487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.875907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.876793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.877584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.878911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.879757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.880536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.974928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:26.986781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7a57a089-501f-4022-8b00-b6879c990e1b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.129797 Sep 13 19:59:26.987395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 858/1725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:27.514120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:27.514730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:27.521240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.521764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.522203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.522903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.523357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.523781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.701988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:27.713890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6df9cb76-a8eb-4f9f-afe8-67397e781faf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.204400 Sep 13 19:59:27.714563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 868/1726] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:27.726293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:27.729214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:27.748015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.748837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.749634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.750888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.751618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.752344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.791675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-08ecf7f5-ff7a-4b79-841c-bf7df31cd19a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069518 Sep 13 19:59:27.792176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 859/1727] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:27 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:27.829553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:27.831862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:27.841658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.842833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.843617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.844869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.845719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.846487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.886843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-82c16b85-9f61-4849-ab72-439c9ba93bc7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061396 Sep 13 19:59:27.888220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 869/1728] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:28.016181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.017407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.027350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.028242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.029009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.030277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.031076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.031834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.126809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:28.135833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4c212899-e980-4139-a8d4-d1bf2937ac0a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.127291 Sep 13 19:59:28.136596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 860/1729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:28.744523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.745517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.755810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.756660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.757396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.758813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.759633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.760405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.804527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.806775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.814493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.815110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.815550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.816256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.816753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.817329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.860376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-488f656c-709e-4f18-a684-d887e5b578f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059273 Sep 13 19:59:28.861388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 861/1730] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:28.907544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.911656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.920330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.920859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.921308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.922074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.922532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.922957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.923584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:59:28.923764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 19:59:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments (ip 10.222.0.23) !!! Sep 13 19:59:28.964392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:28.967166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7748d840-62dc-4f47-b774-d9379bb62569 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065442 Sep 13 19:59:28.967166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 862/1731] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:28.975817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3866e4b-f525-4610-9185-fcb128df883f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.238266 Sep 13 19:59:28.976444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 870/1732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:29.174145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.175195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:29.185627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.186134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.186567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.187268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.187723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.188133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.283827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:29.293056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1eab25ca-1081-4a55-95a9-ec7d61d2bc07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.124405 Sep 13 19:59:29.293736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 863/1733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:29.876826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.879071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:29.889478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.890010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.890450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.891167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.891613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.892042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.926794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1d2a2ceb-7d9c-4b72-82e4-2de048d80e71 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056015 Sep 13 19:59:29.927396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 871/1734] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:29.982969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.988183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.000213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.001102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.001929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.003214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.004036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.006384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.007416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.015016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.015502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.015958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.017042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.017509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.018074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.049049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f151796e-0eec-452f-bc68-a65c4cf2eb73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074154 Sep 13 19:59:30.049672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 864/1735] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:30.186391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:30.200660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-de694396-8fab-4e5a-8ec7-5a291e622e0a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.198907 Sep 13 19:59:30.201764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 872/1736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:30.316796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.317444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.324578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.325222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.325833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.326682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.327136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.327563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.442776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:30.452959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5e77a45a-4e32-4651-9d50-7f04e5d3ea76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.139870 Sep 13 19:59:30.453776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 865/1737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:30.941708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.944723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.953123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.953634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.954097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.954813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.955261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.955691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.989589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8b0f6ea9-aab4-49d9-a291-88639b73c5ab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052454 Sep 13 19:59:30.990207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 873/1738] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:30 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:31.067150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.070830 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.081567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.082387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.083091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.084294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.085085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.085854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.093238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:31.141125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ad619af5-533a-43bc-bdcd-c9a06e2c80cf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080695 Sep 13 19:59:31.142194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 866/1739] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:31.229546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.230598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.241228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.242131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.242830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.243670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.244123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.244573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.425892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:31.434255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aa8608c6-9aed-4f38-8c8f-cc593c54f7c9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.211455 Sep 13 19:59:31.440867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 874/1740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:31.498152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.499182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.509317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.510088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.510632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.511897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.512510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.512943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.590042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:31.599265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ceda5c49-b839-4cb7-81d2-ad7b6a563844 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108764 Sep 13 19:59:31.599938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 867/1741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:32.005418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.008428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:32.015453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.016032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.016473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.017378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.017732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.018074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.053732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-38f409bf-5a65-41e1-a576-00153ade4c7c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054460 Sep 13 19:59:32.054478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 875/1742] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:32.158584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.161186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:32.169910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.170401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.170846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.171552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.171998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.172415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.210475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1be90d5e-41b1-4116-886d-217ffb132a41 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056522 Sep 13 19:59:32.211096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 868/1743] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:32.465055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.466438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:32.474372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.474924 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.475397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.476230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.476764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.477335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.625920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.626553 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:32.646603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.647094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.647530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.648183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:32.648335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.648718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.649321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.660797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fe8cddd5-d241-4f4c-96f3-12c844e4ca68 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.199722 Sep 13 19:59:32.661840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 876/1744] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:32.735283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:32.745972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-46dc8213-ca42-407f-9b82-79add505b13f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.125086 Sep 13 19:59:32.747249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 869/1745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:33.067937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:33.070256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.072731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:33.078417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.078911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.079360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.080082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.080535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.081043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.119291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-65a64702-4bd7-483a-93bc-454286e43d28 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055343 Sep 13 19:59:33.119929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 877/1746] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:33 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:33.224600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:33.226881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.234650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.235146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.235586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.236297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.236752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.237183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.275428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eb8e9c49-5858-4df0-8aa7-89446af54a48 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055101 Sep 13 19:59:33.276328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 870/1747] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:33.687557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:33.688201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.700045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.700850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.701552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.702542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.703186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.703611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.773824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:33.774675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.783246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.784022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.784938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.785518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.786228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.787018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.907543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:33.917517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ce29e38d-9f1e-400f-b5d1-447879e86adc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.149871 Sep 13 19:59:33.919320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 871/1748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:33.942123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:33.951378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e0b733d8-47f1-44b8-911c-dd1a068e37fa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.267852 Sep 13 19:59:33.951988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 878/1749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:34.136167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.138902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.145413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.145948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.146385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.147115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.147557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.148055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.182242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0cc2361e-d2cd-46a0-970a-07fe68838945 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052711 Sep 13 19:59:34.182838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 872/1750] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:34.295480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.299279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.309122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.309697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.310149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.311016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.311475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.311899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.362782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9ff7ba9e-d9d5-4a22-ae2c-c8f664b82a90 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074260 Sep 13 19:59:34.364155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 879/1751] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:34.947298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.948201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.958110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.958648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.959086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.959878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.960334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.960760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.989844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.990984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.000130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.000932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.001676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.002817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.003511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.004227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.042231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:35.051610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4a5511a0-81e9-4962-9f72-fcd243ce4322 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108472 Sep 13 19:59:35.052203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 873/1752] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:35.196946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.200444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.211249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.212093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.212800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.214086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.214969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.215750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.272898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-08dcf7e2-6876-4c33-9b7f-c1d72d5ac65a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080181 Sep 13 19:59:35.273845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 874/1753] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:35 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:35.379222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.381488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.383449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:35.390168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.390669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.391110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.391890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.392315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.392738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.430568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c212d133-1494-48bc-a04f-0069ff8ae105 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056918 Sep 13 19:59:35.431365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 875/1754] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:35 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:35.482460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:35.492997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b74515db-b0ee-437c-aad9-a9f8f0afbd25 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.516304 Sep 13 19:59:35.505339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 880/1755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:36.078576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.079787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.088962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.089504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.090268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.091554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.092384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.093132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.182874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:36.191340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f9a21ed8-5043-406d-82ae-b22686bc02b9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.119783 Sep 13 19:59:36.191928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 876/1756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:36.290291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.293047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.300168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.300761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.301273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.302121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.302660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.303180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.341268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6f112d67-d062-48fa-aea9-31ae074706a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055457 Sep 13 19:59:36.342055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 881/1757] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:36.446076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.448603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.455364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.455892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.456321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.457047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.457506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.457975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.499608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ef0a6a99-bbac-4191-bc4f-7f7dc681194b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058997 Sep 13 19:59:36.500425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 877/1758] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:36.520647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:36.521814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:36.532960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.533886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.534963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.536198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:36.537000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:36.537821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:36.721283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:36.730765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-920b93a0-9fbc-48ce-b93d-376be0f803d4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.217038 Sep 13 19:59:36.731369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 882/1759] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:37.219291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:37.220417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:37.232529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.233296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.234016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.235301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.236029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.236704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.346649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:37.356941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c3dce3d9-10a2-4768-a910-a502befb076f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.145286 Sep 13 19:59:37.357756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 878/1760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:37.357966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:37.362198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:37.371738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.372372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.373213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.373753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.374171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.374375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.416312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-376d0755-8f3c-499e-a02d-8005d8c74401 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064438 Sep 13 19:59:37.416936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 883/1761] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:37 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:37.517197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:37.522192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:37.536121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.536977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.537770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.539008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.539810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.546575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.624695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bbee6c2c-1588-4087-90bc-032e9aa6f775 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114377 Sep 13 19:59:37.625801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 879/1762] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:37.766885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:37.767844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:37.775765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.776340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.777076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.778261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:37.779070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:37.779614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:37.783214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:37.961933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:37.976620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-47add960-3989-4823-b480-f9f02c945c01 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.216431 Sep 13 19:59:37.978265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 884/1763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:38.389723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:38.390687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:38.400191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.400764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.401208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.401962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.402440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.402897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.434514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:38.438163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:38.445584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.446101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.446530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.447226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.447694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.448110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.482409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:38.485643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-803f68f5-1ee7-4bd8-9701-25ae49f947f3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058945 Sep 13 19:59:38.486340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 885/1764] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:38 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:38.496167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-85d84200-aa15-46d0-9ee9-7a6f75e1b404 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112752 Sep 13 19:59:38.497105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 880/1765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:38.645949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:38.648282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:38.657024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.657969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.658445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.659476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:38.660019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:38.660829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:38.729833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4da65fc5-6318-42cb-963e-0b3544c9964e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087867 Sep 13 19:59:38.731241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 886/1766] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:39.014498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.015035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.025421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.026345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.026889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.028641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.029346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.030031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.205679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:39.215644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7c6ce495-cd69-4445-977b-d723df7ea0c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.205109 Sep 13 19:59:39.217030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 881/1767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:39.499613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.501918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.509272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.509926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.510403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.511173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.512372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.512885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.527734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.528810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.540037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.540833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.541580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.542825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.543650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.544323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.550337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8e87380a-a4f5-4084-8016-53a8106b6648 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055082 Sep 13 19:59:39.550925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 887/1768] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:39.629797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:39.633775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:39.645715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2714b3af-84a1-4e4b-9dbf-57d36863c25e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.122800 Sep 13 19:59:39.646550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 882/1769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:39.745249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.748216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.755299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.755688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.756139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.756879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.757342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.757825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.794589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-efb18d7d-d19a-4e33-886b-93f02b338c93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054505 Sep 13 19:59:39.795232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 888/1770] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:40.245095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.246246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.253473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.253997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.254430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.255134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.255582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.256002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.436237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:40.448067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2e13e2de-7814-4c81-a914-78f95f4cd47b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.207490 Sep 13 19:59:40.449653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 883/1771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:40.570073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.573774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.586202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.587060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.587841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.589049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.590489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.591271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.632250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8a9aa2b4-16b2-42b6-9c01-231427571ded tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069658 Sep 13 19:59:40.632840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 889/1772] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:40.672369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.673005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.680228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.680728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.681164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.681918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.682367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.682791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.757166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:40.772937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-28724a6f-d7a1-49db-93fe-d49d494bdcde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104896 Sep 13 19:59:40.774021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 884/1773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:40.810741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.812970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.819777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.820304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.820770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.821530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.822104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.822564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.861763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9afef09-8a2b-4ab6-a480-5a77c5cbc371 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055798 Sep 13 19:59:40.862509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 890/1774] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:41.475054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.475738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.482877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.483520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.483954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.485884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.486983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.487644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.648388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.652387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.660117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.660616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.661154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.662090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.662496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.662905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.666000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:41.674923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-077871f0-28eb-4308-bcdc-b05b430c5e85 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.203948 Sep 13 19:59:41.675985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 885/1775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:41.701469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-591f3875-230c-4d64-9251-61597297a948 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060037 Sep 13 19:59:41.702222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 891/1776] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:41.797251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.797897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.805743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.806405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.806953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.807917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.809042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.809600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.881411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.884965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.892439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.892935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.893888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.894392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.895847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:41.896182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.896182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.909538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d94973a5-1b1f-4df4-8d6a-87feae649cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.115464 Sep 13 19:59:41.910652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 886/1777] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:41.938503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-460f9195-7ab3-4a10-9a08-f6a47cb5dc1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063329 Sep 13 19:59:41.939121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 892/1778] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:42.703706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.704842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.714615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.715296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.715888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.716874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.717672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.718326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.720338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.723212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.730667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.731158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.731594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.732296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.732744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.733169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.770366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-61ee9e3f-f0e2-40fa-a0f5-86dc0e71d9bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057285 Sep 13 19:59:42.770963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 893/1779] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:42.911165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:42.925916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-190d9c86-24a8-404b-9621-b40bf91dcaba tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.227763 Sep 13 19:59:42.926924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 887/1780] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:42.951132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.952495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.955742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.958044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.963891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.964449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.964887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.965592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.966191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.966619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.969375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.970197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.970891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.972089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.972909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.973694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.014746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8bd0a90e-c167-4eef-ada8-f990cdec32a6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063674 Sep 13 19:59:43.015690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 888/1781] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:43.043310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:43.054552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4f8f0ccb-c1a7-4a36-b66e-7ec87f47cad1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110606 Sep 13 19:59:43.055296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 894/1782] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:43.784333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:43.787412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:43.798648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.799527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.800304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.801698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.802399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.803151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.857330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-494b1fda-01e6-467f-9aa3-d7009592236c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077889 Sep 13 19:59:43.857955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 889/1783] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:43.959622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:43.960768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:43.973221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.974052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.974756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.975920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.976645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.977356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.029118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.031577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.039455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.040218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.041097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.042628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.043331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.043975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.086219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-460273de-363d-4b20-9f61-7ea7a7b1c7e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062269 Sep 13 19:59:44.086841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 890/1784] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:44.092867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.093490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.101332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.101332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.101881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.103487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.104364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.105298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.189048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:44.200379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aa8182b6-2409-410b-97a6-8ae7f9088651 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.248303 Sep 13 19:59:44.201026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 895/1785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:44.209816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:44.220694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ca74c6f-3ec8-4923-96b1-ea576380ffbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.132621 Sep 13 19:59:44.221319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 891/1786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:44.871582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.875132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.884396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.884888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.885323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.886070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.887065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.887487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.922544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5f2bc011-72f9-4f4e-81bc-15291778a7c1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056298 Sep 13 19:59:44.923270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 896/1787] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:45.103263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.106152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.114437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.114930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.115378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.116094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.116568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.117005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.155870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de4cd268-de72-479c-bf5e-556b0e6aedda tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058038 Sep 13 19:59:45.156471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 892/1788] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:45.225359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.226225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.233660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.234153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.234580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.235277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.235724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.236139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.262254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.264434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.278219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.278644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.279239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.280212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.280672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.281099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.385951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:45.396136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e8148347-49dc-46f1-abaa-4cd86bb9a681 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.142144 Sep 13 19:59:45.396871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 893/1789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:45.428611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:45.444429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7baaaa9e-8981-4674-bd1e-8d28fbed1bdc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.222678 Sep 13 19:59:45.445556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 897/1790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:45.937915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:45.940828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:45.947473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.947966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.948403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.949730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:45.950191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:45.950646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.989547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4d12900b-dcec-40fd-9794-dd863fbfdd25 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057289 Sep 13 19:59:45.990175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 894/1791] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:46.169684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:46.172726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:46.183415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.184049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.184501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.185371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.186032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.186663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.223678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-718731a6-456b-4a6f-96f2-953bf9b98f30 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059050 Sep 13 19:59:46.224273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 898/1792] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:46.425048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:46.425850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:46.435467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.436245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.436995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.438192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.438932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.439625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.474710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:46.475531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:46.486515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.487232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.488095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.489132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.489870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.490708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.532056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:46.540263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-373097ce-be89-4246-aaf0-b30bdc40a0e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.122589 Sep 13 19:59:46.543366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 895/1793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:46.650869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:46.660442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aa554183-ebb7-4ee8-ac30-87db5b2b9be7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.191625 Sep 13 19:59:46.661020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 899/1794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:47.007505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.011021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.020508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.021159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.021710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.022317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.022767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.023194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.056989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-73a459fb-ad3b-4bb6-85aa-6d441c7a9f44 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057321 Sep 13 19:59:47.057665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 896/1795] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:46 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:47.239368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.241511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.249987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.250485 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.250936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.251638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.252092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.252519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.279988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:47.287382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5ae295a4-92c9-453b-a425-cf7b656d1542 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052402 Sep 13 19:59:47.288926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 900/1796] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:47.571114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.571837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.579739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.580324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.580858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.582055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.582548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.582976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.667794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:47.682155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6340fbf-3b37-4f88-af92-6d9e264ba1cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116176 Sep 13 19:59:47.683715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 897/1797] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:47.700308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.702763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.715405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.717299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.718070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.719473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.720271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.733302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.936805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:47.951280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-94db794b-8ee5-48eb-baec-a065132b7294 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.261877 Sep 13 19:59:47.951973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 901/1798] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:48.074809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.077034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.084515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.085007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.085449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.086228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.086680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.087106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.123628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-74ab1fb4-6c50-4c3d-b05b-30bdff0ecc42 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055670 Sep 13 19:59:48.124247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 898/1799] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:48.302517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.304744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.311344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.311850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.312297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.313029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.313490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.313956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.357373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-47887db7-63cd-45dc-8c3f-5f3d513ae7ec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058913 Sep 13 19:59:48.358535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 902/1800] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:48.711171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.712158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.722192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.723001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.723758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.724905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.725690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.726448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.755567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.811122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:48.822633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ffb79f6b-6545-4c7e-9040-ce3a35149846 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118524 Sep 13 19:59:48.824124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 899/1801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:48.979113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.980118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.989392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.990227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.990880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.991729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.992360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.992785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.136953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.139192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.147175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.148426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.148426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.149729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.149729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.150641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.189452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2f563316-23ff-4ca3-b3b9-8d8b1b0a7deb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055967 Sep 13 19:59:49.190458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 900/1802] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:49.194021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:49.203516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-989415f7-cc57-474d-84c6-1b5c74624f72 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.230213 Sep 13 19:59:49.204569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 903/1803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:49.376843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.379063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.385988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.386472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.386915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.387617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.388058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.388479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.424974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d53b6860-f0b5-48d6-b667-018eca6ed50d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055026 Sep 13 19:59:49.425564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 901/1804] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:49.850448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.851052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.857846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.858327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.858759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.859453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.859910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.860312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.954512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:49.963745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d01c05bd-37c8-47fa-8a6f-7c6114feb01c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117636 Sep 13 19:59:49.964374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 904/1805] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:50.206539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.209348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:50.217976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.218544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.219190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.219951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.220579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.221275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.233222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.233931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:50.240731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.241218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.241793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.242647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.243144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.243557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.274571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9eb06e12-b818-4bcb-849a-6a157ba0ffd4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075386 Sep 13 19:59:50.275141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 902/1806] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:50.415761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:50.425791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6703a146-b994-4cc8-b993-feb933a3d287 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.198099 Sep 13 19:59:50.426392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 905/1807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:50.440973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.443769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:50.451562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.452193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.452786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.453708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:50.454289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:50.454955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.492894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9f5ce6d5-c7f3-4724-91f0-e9e0b2574f51 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056284 Sep 13 19:59:50.493405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 903/1808] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:50.992072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:50.992901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:51.000650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.001137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.001575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.002307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.002754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.003176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.097479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:51.109983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-04d36c4a-4c28-44e0-83e1-97b91cefb394 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.125147 Sep 13 19:59:51.110575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 906/1809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:51.290828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:51.293859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:51.305257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.305931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.306694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.308513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.309379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.310196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.358489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e6dd1209-e427-41a8-a6b5-8b980d417452 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072711 Sep 13 19:59:51.359165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 904/1810] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:51 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:51.459356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:51.460505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:51.472017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.472887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.473684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.474940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.475760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.476543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.508702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:51.511072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:51.517262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.517812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.518257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.518958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.519404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.519831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.560291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c6a73af9-857f-4ec5-8aac-b017f4a0f6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055699 Sep 13 19:59:51.560788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 905/1811] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:51.660646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:51.674476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a1586380-ad18-4373-9ab3-55298f01d11e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.221745 Sep 13 19:59:51.675333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 907/1812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:52.142887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:52.143909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:52.155208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.156076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.156847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.158082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.158563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.159326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.241011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:52.251756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dbae1f98-e23a-46de-be07-fa99242ecee8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.114512 Sep 13 19:59:52.251756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 906/1813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:52.375027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:52.377268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:52.386081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.386659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.387137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.387882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.388368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.388791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.427670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7f9ce63f-7fbd-4f7e-92c1-2acafe42ddb2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057615 Sep 13 19:59:52.428193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 908/1814] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:52.574772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:52.577205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:52.584418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.584909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.585348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.586090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.586537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.586959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.629742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b949e49c-985a-48f7-b952-a5e44e096a9c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059957 Sep 13 19:59:52.630336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 907/1815] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:52.708556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:52.714292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:52.719712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.720506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.721250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.722529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:52.724404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:52.724404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:52.918211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:52.927253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3d7d29ef-077f-40cf-8e69-14b418288a31 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.226186 Sep 13 19:59:52.927253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 909/1816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:53.281751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:53.282505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:53.293180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.294106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.294913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.296188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.296884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.297652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.381924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:53.391416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8c43ca55-d8fb-492e-a2cb-13185764cd67 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117357 Sep 13 19:59:53.392013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 908/1817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:53.440584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:53.443084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:53.452772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.453371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.454013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.455127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.455892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.456674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.495029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dccec860-f805-4251-b7d4-e232fe05e899 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058304 Sep 13 19:59:53.495956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 910/1818] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:53.645403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:53.647734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:53.654516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.655002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.655439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.656147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.656599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.657020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.691629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-04e08682-5fef-4dda-aa63-d74304592bec tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051203 Sep 13 19:59:53.692364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 909/1819] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:53.956664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:53.957557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:53.965954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.966426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.966857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:53.967543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:53.967984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:53.968490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.164637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:54.174066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-64eae736-37b1-4c7f-b8bc-c4bcee352b82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.223953 Sep 13 19:59:54.174657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 911/1820] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:54.426157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:54.427005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:54.438948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.439430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.439861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.440622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.441304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.441806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.509136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:54.511472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:54.518472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:54.519870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.520413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.520851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.521545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.522016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.522435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.531973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-15934736-d6ac-4c25-a1df-642e36c4c882 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110103 Sep 13 19:59:54.533070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 910/1821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:54.567725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6e819311-a97b-4807-b78b-74659d8ccb9d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062471 Sep 13 19:59:54.568820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 912/1822] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:54 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:54.711721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:54.715032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:54.725283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.726138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.726826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.727962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:54.728434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:54.729113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:54.785599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8f3fa9e8-36ae-4f31-b469-7bcfb6966788 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080790 Sep 13 19:59:54.786480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 911/1823] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:55.199842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:55.200654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:55.211168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.212045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.212734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.214583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.215358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.216079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.418819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:55.429651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6c2d3f61-bb02-49af-9fe5-75d49b27215e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.235038 Sep 13 19:59:55.430730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 913/1824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:55.565010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:55.565635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:55.571946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.572431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.572865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.573629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.574084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.574509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.586967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:55.590396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:55.597712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.598209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.598648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.599355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.599803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.600225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.637706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f115972-9d72-427b-8e09-aa807ea84b7d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057318 Sep 13 19:59:55.639199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 914/1825] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:55 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:55.661254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:55.670578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-762573b2-32c2-46cd-8c33-7d22087a7282 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109349 Sep 13 19:59:55.671169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 912/1826] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:55.804040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:55.806997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:55.814744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.815227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.815651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.816344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:55.816788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:55.817200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:55.855185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-26f5cae6-eb3c-4eec-9b7d-2f56587e8c3c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057098 Sep 13 19:59:55.855740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 915/1827] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:56.467553 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:56.468172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:56.474978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.475461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.475892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.476946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.477597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.478370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.656128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:56.658480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:56.665720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.666563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.667197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.668172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.668798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.669329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.679239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:56.692564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3690bd18-3ef1-4ac2-a615-14082c3d9c0d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.229548 Sep 13 19:59:56.693882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 913/1828] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:56.700028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:56.700742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:56.708946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.709920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.710749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.711975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.712641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.713384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.727110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bc4e186a-759d-4987-b280-1f4cf9daf514 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077954 Sep 13 19:59:56.728329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 916/1829] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:56 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:56.801805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:56.810648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9e8036ed-939f-47e9-8b28-c5810864ade9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.115542 Sep 13 19:59:56.811229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 914/1830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:56.869036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:56.871971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:56.881013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.881558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.882091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.882859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:56.883426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:56.883932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:56.909246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:56.948711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-93cd9371-70e6-4b26-8dfa-3c33379ec269 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083165 Sep 13 19:59:56.949772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 917/1831] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:57.722603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:57.723783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:57.733908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.734593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.735231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.736423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.737131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.737781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.747075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:57.750577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:57.762381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.762986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.763573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.768245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.768245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.768245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.817975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ac95a149-3d6b-46ca-8a50-d09e7de60913 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076535 Sep 13 19:59:57.819067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 918/1832] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:57 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:57.838200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:57.839503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:57.850033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.850787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.851482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.852585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.853251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.853704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.941748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:57.957323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-38cc8e62-5960-4f68-ace9-474e970ea11b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.240405 Sep 13 19:59:57.957509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:57.958798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 915/1833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:57.965279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:57.966893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-89f9c2a6-e9c5-4840-b86a-a1a440928e5f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.136219 Sep 13 19:59:57.974044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:57.974420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 919/1834] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:57.975288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.975865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.976309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.977112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:57.977524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:57.977999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:57.982007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:58.017705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-64f9a15f-4b7a-4d5e-97bd-5caee89a0e6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057279 Sep 13 19:59:58.018323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 916/1835] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:58.834797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:58.837132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:58.844655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:58.845133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:58.845567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:58.846295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:58.846741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:58.847157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:58.881217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1b17120b-1d5c-4eeb-abd7-22e4c8549c4b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050517 Sep 13 19:59:58.881944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 920/1836] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:58 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:58.997285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:58.997958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:59.003963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:59.004892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:59.005577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.006411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.007118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.008270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.009027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.009774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.015194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.016175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.019103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.019103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.019103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.019945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.131235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:59.145869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d7929dca-cd1d-45a8-aaf4-55553cab7239 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.152799 Sep 13 19:59:59.146933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 917/1837] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:59.155366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:59.157577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:59.169417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.170329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.171125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.172382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.173255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.174080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.214609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:59.215348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-71aff238-c14d-42b0-8fd3-5609e429f244 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066878 Sep 13 19:59:59.216157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 918/1838] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:59.228345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1917b972-db8d-4197-ac87-6d8a0a1f3905 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.229230 Sep 13 19:59:59.229713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 921/1839] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:59.897255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:59.899736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:59.907156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.907665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.908106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.909089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:59.909536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:59.909983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:59.945811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e16e9dcb-cda6-4933-a0fb-14399df1716e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053022 Sep 13 19:59:59.946395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 919/1840] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:59 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:00.174193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:00.175270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:00.186906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.187735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.188441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.189673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.190444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.191154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.231082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:00.236348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:00.247521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.248261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.248924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.250224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.251051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.251703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.273147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:00.287810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8b80149d-4c60-4be3-99dd-5de18a1419dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.119278 Sep 13 20:00:00.289342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 922/1841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:00.301210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5775a9f8-6294-478d-a95d-ed5a26cd68df tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076422 Sep 13 20:00:00.301559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:00.306782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:00.306986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 920/1842] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:00.311451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.312121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.312726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.313504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.313978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.314402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.518133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:00.534560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b25d70f4-eb06-4901-8c7a-11d12f2331ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.237784 Sep 13 20:00:00.534560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 923/1843] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:00.963735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:00.967552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:00.976360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.976855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.977294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:00.978035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:00.978487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:00.979483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.028310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3305abee-6660-4f38-b581-e20bf37e5476 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072389 Sep 13 20:00:01.029196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 921/1844] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:00 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:01.318491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:01.321856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:01.328471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:01.329506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:01.330242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.330985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.331687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.332417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.332868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.333372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.341438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.342287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.343017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.344207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.344684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.345155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.391728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8ba66d8e-5743-49a3-9b54-30d0ba45ea89 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080376 Sep 13 20:00:01.392531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 924/1845] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:01.445532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:01.457210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4cc87f80-87bc-45b6-ab0f-e3d328b6e2b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.135823 Sep 13 20:00:01.458139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 922/1846] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:01.558888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:01.559907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:01.566903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.567458 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.567993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.568905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:01.569453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:01.570030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:01.756399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:01.770616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f81409a9-e9f3-4fdf-b5ed-e556c764a988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.218586 Sep 13 20:00:01.771652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 925/1847] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:02.046995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:02.049198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:02.055636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.056127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.056577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.057868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.058320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.058746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.098740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-10b94e5f-95d5-4a7b-bd69-1b1c59981589 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057291 Sep 13 20:00:02.099814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 923/1848] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:02 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:02.406851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:02.409832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:02.417547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.418059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.418491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.419185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.419628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.420042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.464996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-91fabe19-ca6b-437a-9ab9-589fd669b043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062298 Sep 13 20:00:02.465685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 926/1849] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:02.498471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:02.499577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:02.511392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.512260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.513037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.514316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.515117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.515882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.594659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:02.608796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-66c5f977-6f69-434d-a3a6-a1ba79955fc9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117325 Sep 13 20:00:02.609839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 924/1850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:02.810369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:02.811030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:02.813089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:02.820142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.820723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.821256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:02.822131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:02.822700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:02.823197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.018167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:03.029079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f48239f-4560-4858-9b2b-44b898a14049 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.223402 Sep 13 20:00:03.030261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 927/1851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:03.116237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:03.118897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:03.121076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:03.126622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.127109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.127624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.128366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.128834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.129330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.188683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f0768ef0-1391-47dd-b373-3df8f4c3e7e3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077004 Sep 13 20:00:03.189684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 925/1852] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:03 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:03.480083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:03.483323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:03.493234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.494137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.495423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.496495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.497175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.497898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.534082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-42f6bdfb-6de0-449c-97a6-ad36f44b2978 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058941 Sep 13 20:00:03.534669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 928/1853] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:03.642632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:03.643719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:03.654662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.655561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.656359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.657522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:03.658306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:03.659204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:03.759888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:03.774250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4cff655f-26ed-4204-9adf-35b7b9cdd975 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.138395 Sep 13 20:00:03.775324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 926/1854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:04.065270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:04.066445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:04.076646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.077420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.078081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.079182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.079871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.080612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.211573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:04.215926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:04.227322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.228187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.229030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.230336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.231163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.231950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.273791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d6a9aa6e-2c30-4e5d-97b4-622fc5832646 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070360 Sep 13 20:00:04.274134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 927/1855] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:04 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:04.276650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:04.285707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f4cad4f4-687e-4283-a03a-a954ee9926a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.228615 Sep 13 20:00:04.286315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 929/1856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:04.552345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:04.555828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:04.564193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.564696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.565144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.566059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.566693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.567138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.609505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4e99573b-90e3-49d8-beb7-dbac9f70825a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064372 Sep 13 20:00:04.610589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 928/1857] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:04.814257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:04.815043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:04.822540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.823022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.823451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.824148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:04.824595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:04.825029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:04.905306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:04.918434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-24e4c175-b499-4ff6-bc16-c6be65da711c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108352 Sep 13 20:00:04.919034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 930/1858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:05.294570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:05.298273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:05.309996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.310850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.311597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.312853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:05.313073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.313523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:05.313739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.314585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.322100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.323116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.323561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.324287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.324735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.325155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.367313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-77a014f8-df8b-412f-acb2-90290468a4f7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080900 Sep 13 20:00:05.368248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 929/1859] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:05 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:05.512570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:05.521702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9deb42b3-9c4f-4fb3-a6b8-f2d38397430b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.214540 Sep 13 20:00:05.522465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 931/1860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:05.625912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:05.628271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:05.635372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.636034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.636595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.637422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.638059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.638607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.683599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0e6990ef-10e8-4b32-af71-7fa578a0ba49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058824 Sep 13 20:00:05.683599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 930/1861] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:05.947869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:05.948782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:05.958318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.958794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.959253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:05.959956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:05.960416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:05.961034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.048413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:06.060557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ff8a26d8-b8e2-4036-9b57-49df811b05d9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.119833 Sep 13 20:00:06.061454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 932/1862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:06.382702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.385520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.392589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.393114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.393581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.394300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.394741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.395209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.432214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fa2b6ec5-24d0-419a-9884-9d60257111bc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053684 Sep 13 20:00:06.433061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 931/1863] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:06.546868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.547496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.553974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.554867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.555558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.556585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.557921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.558720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.700269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.702959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.710510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.711011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.711458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.712225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.712707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.713218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.764417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:06.774221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-638f76e5-8bf4-477c-af95-2bc41de1de7d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080438 Sep 13 20:00:06.774805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 932/1864] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:06.821728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.823274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.833944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.835132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.835736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.836937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.837728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.838526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.839747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:06.847957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-20ac10a4-d6c9-4063-ba0a-ebc9a1dd544f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.305330 Sep 13 20:00:06.848537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 933/1865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:06.875706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:00:06.932503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.api [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Instance is already in deleting state, ignoring this request Sep 13 20:00:06.933514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-14ce8cdd-8138-4882-bd6f-9cd978cf5b6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 204 len: 0 microversion: 2.1 time: 0.119063 Sep 13 20:00:06.934297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 933/1866] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:00:06 2022] DELETE /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:00:06.946700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.947877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.959256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.960092 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.960879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.962195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.963077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.963920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.972643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:07.046956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:07.056076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b6b6df48-d4cf-4936-86a8-8b0e00681cc1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116275 Sep 13 20:00:07.056614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 934/1867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:07.447469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.450702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.461129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.462084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.462887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.464166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.465010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.465819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.503601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dee732d5-033e-4917-afd4-a58623a4c9af tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060682 Sep 13 20:00:07.504261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 934/1868] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:07.793058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.796704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.807750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.808433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.809196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.810435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.811204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.811923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.847622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d321f795-c0b3-4401-b645-6bb711569eb4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061921 Sep 13 20:00:07.848480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 935/1869] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:07.877735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.878856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.891706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.892613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.893544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.895002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.896254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.896962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.086244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.087711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.102729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:08.103039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.103039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.103039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.103039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.109523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.109523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.109821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4b9f9e77-a4ce-46cb-9468-ef74ace93fe9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.231448 Sep 13 20:00:08.109821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 935/1870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:08.185333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:08.194264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f8afed34-b1af-4507-8ecf-b2aec7cb4732 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113916 Sep 13 20:00:08.194858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 936/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:08.517041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.519166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.528201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.528704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.529163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.529871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.530320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.530741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.564333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3fd1e8fd-14bb-4fd0-955d-dea92fd4fb1e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051869 Sep 13 20:00:08.564910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 936/1872] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:08 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:08.861141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.863505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.869898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.870379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.870810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.871519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.872040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.872726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.912020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3f69c2c-fb69-465f-bbb1-f8cb48852902 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054845 Sep 13 20:00:08.912579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 937/1873] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:09.133931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.134478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.141207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.141732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.142174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.142874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.143334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.143767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.221039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.222100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.228958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.229454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.230002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.230909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.231361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.231792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.315545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:09.325891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-22795802-ee2e-4805-8586-be18913c476a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.198332 Sep 13 20:00:09.326484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 937/1874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:09.332663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:09.351300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d8664ef6-faf4-4504-bf86-432b27c9a30a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.135237 Sep 13 20:00:09.351990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 938/1875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:09.581143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.583597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.590683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.591168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.591611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.592354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.592805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.593323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.625737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ea774a31-7f27-4dae-ae3a-de2f9a158527 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048650 Sep 13 20:00:09.626307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 938/1876] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:09.924600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.926941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.933565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.934069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.934499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.935181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.935620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.936033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.964600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-49605c77-2cab-4c5c-9113-af50fb97e240 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Sep 13 20:00:09.965165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 939/1877] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:10.359322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:10.359845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:10.366303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.366784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.367215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.367947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.368387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.368864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.374355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:10.374974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:10.382269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.383112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.383660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.384083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.385625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.386298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.482569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:10.492001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d77e4c8e-caa5-47c9-af47-de36b2a4e372 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.121473 Sep 13 20:00:10.492957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 940/1878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:10.559527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:10.569199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-37358e9e-bfcb-4165-9716-265d368fcc8e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.213877 Sep 13 20:00:10.569806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 939/1879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:10.639379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:10.641696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:10.648715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.649197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.649649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.650985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.651432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.651852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.684673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ca25385f-e17d-4c70-8701-fea6fe70df7b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049779 Sep 13 20:00:10.685356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 941/1880] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:10 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:10.978496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:10.980266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:10.987061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.987546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.988008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:10.988667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:10.989112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:10.989529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.033005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34898b44-54f1-4ac2-9c11-6d1ad94b2757 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059352 Sep 13 20:00:11.034080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 940/1881] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:11.515514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.516171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.522955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.523445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.523889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.524599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.525045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.526005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.596975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.598307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.604685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:11.607556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.608064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.608689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.609896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.610717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.611479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.625813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4126aaf2-b6d1-4b58-8cf3-4a771cf6b3fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113875 Sep 13 20:00:11.626459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 942/1882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:11.696812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.699049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.705090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.705574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.706048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.706745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.707193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.707616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.743046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4e783b64-1bda-47e4-896c-22f65b8af943 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050296 Sep 13 20:00:11.743627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 943/1883] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:11.778989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:11.792767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5bae3775-6805-4797-adbd-b1239fbe57f3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.201737 Sep 13 20:00:11.793541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 941/1884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:12.052590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:12.055347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.062245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.062849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.063385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.064181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.064735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.065251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.157095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-99f2cf58-3e1e-485c-bdae-0ae36c0f9246 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/action" status: 200 len: 76159 microversion: 2.1 time: 0.110959 Sep 13 20:00:12.157778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 944/1885] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 20:00:12 2022] POST /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07/action => generated 76159 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:00:12.650068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:12.650909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.657623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.658122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.658820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.659520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.659971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.660395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.742649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:12.752360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-055f9e15-c672-42ad-bc74-ac10fc0123bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106018 Sep 13 20:00:12.753097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 942/1886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:12.759098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:12.762328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.770021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.770607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.771110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.771915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.772372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.772793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.809238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-46e0b603-ec4f-4eff-831a-5a4303e4d23f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055459 Sep 13 20:00:12.809883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 945/1887] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:12 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:12.819394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:12.820015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.826708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.827239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.827791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.828538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:12.829054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:12.829675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:12.996255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:13.005414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-747d0649-966f-44b8-bb71-0e37981f5417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.190001 Sep 13 20:00:13.006205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 943/1888] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:13.790310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:13.791063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:13.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.798159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.798589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.799272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.799717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.800136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.821795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:13.824441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:13.831445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.831932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.832377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.833080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.833594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.834091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.866323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-63ad73ae-9293-4364-9be2-53b932cb178d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048540 Sep 13 20:00:13.866928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 944/1889] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:13 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:13.877367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:13.889750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2cb7264f-49c8-4660-89b8-4ab47b3cd110 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104450 Sep 13 20:00:13.890471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 946/1890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:14.030748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.031359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.037817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.038210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.038643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.039336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.039784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.040205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.187804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:14.196146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e4c17b95-1ecb-4c32-96ee-32cbdd916ac4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.170247 Sep 13 20:00:14.196744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 945/1891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:14.880616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.882828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.890221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.890705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.891131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.891827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.892264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.892681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.913257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.913990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.921020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.921494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.921959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.922642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.923079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.923499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.924186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ec20d893-41e3-4353-a8d4-648f4771ad20 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047527 Sep 13 20:00:14.924750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 947/1892] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:14.999166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:15.008230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3bb6522f-cc6c-44ba-bcb4-a24f7ece7654 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099013 Sep 13 20:00:15.008828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 946/1893] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:15.222912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:15.223551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:15.230831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.231319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.231754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.232453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.232901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.233321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.393382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:15.403532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6fe035b6-209c-43fd-8ee6-43a5f3168d2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.184501 Sep 13 20:00:15.404108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 948/1894] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:15.939265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:15.941444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:15.948352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.948841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.949290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.950033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.950482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.950906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.983357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2ed590bb-0422-4355-8136-08739986373f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048145 Sep 13 20:00:15.983947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 947/1895] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:15 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:16.031964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:16.032575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:16.039913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.040392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.041380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.042104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.042550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.042980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.116356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:16.124973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-82a899eb-887a-4f63-a110-39ad05e94b21 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096759 Sep 13 20:00:16.125552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 949/1896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:16.427327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:16.427938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:16.436232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.436773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.437235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.437983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.438441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.438874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.441716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:16.643408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:16.661901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-33d6733a-cc6c-4cb0-bd3a-fbd700b9ac24 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.238025 Sep 13 20:00:16.662951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 948/1897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:16.997165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:16.999407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:17.006200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.006811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.007477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.008305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.008845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.009941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.049035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-769102bc-db46-4620-8edd-cdcc746663b6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056659 Sep 13 20:00:17.050122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 950/1898] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:16 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:17.154157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:17.155188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:17.164825 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.165394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.165919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.166933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.167440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.168054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.268858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:17.277283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-16a38424-7f93-40b8-90ab-38bfaffb7641 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.131313 Sep 13 20:00:17.278459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 949/1899] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:17.695816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:17.696438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:17.703446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.704065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.704563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.705395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.705939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.706414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.709776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:17.878324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:17.893289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7616230a-df88-440d-b255-c2bcb54e88b6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.201985 Sep 13 20:00:17.894341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 951/1900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:18.064038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:18.066332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:18.074440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.075056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.075644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.076498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.077023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.077499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.115275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c8802bb4-335d-46e6-8394-6110be4d22c2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056112 Sep 13 20:00:18.115869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 950/1901] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:18 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:18.301186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:18.302100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:18.311772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.312657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.313441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.314723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.315532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.316282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.386855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:18.397543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a2d15d5b-1ac3-496c-bacf-c4668d9146ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099981 Sep 13 20:00:18.398540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 952/1902] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:18.921132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:18.922434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:18.936386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.936868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.937297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.938226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:18.938677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:18.939096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.132315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:19.135862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:19.139844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:19.142835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.143372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.143808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.144514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.144985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.146178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.153664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2b23160c-aad7-428d-9098-1f116700510f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.236602 Sep 13 20:00:19.154534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 951/1903] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:19.199343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b3f4e920-7d01-41cd-9fc6-4c442c232239 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073825 Sep 13 20:00:19.200318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 953/1904] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:19 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:19.426424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:19.427291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:19.433932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.434636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.434936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.435635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.436137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.436611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.504014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:19.516580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6b4e7c2a-6597-4960-8168-f9731ca8b32e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096804 Sep 13 20:00:19.517571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 952/1905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:20.193383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:20.194022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:20.201296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.201821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.202258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.202955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.203403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.203823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.215030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:20.217821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:20.224659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.225143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.225574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.226298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.226746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.227168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.269217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5c211d25-c929-40fe-bc0c-5c2e234e0b72 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059124 Sep 13 20:00:20.269840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 953/1906] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:20 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:20.391268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:20.400300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-635e5ac6-dd3f-4e53-bc34-5f221162a357 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.210747 Sep 13 20:00:20.400865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 954/1907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:20.544652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:20.545238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:20.551851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.552476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.553005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.553955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.554508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.555037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.637226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:20.646036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1bba0b5e-9a29-4c81-a6c7-7fa95e218fdc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106384 Sep 13 20:00:20.646822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 954/1908] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:21.282750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:21.286849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:21.297206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.298107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.298903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.300189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.301078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.301945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.339621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cf1bf509-9d91-466d-87c1-62884db52607 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061144 Sep 13 20:00:21.340197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 955/1909] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:21 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:21.424820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:21.425431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:21.434943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.435450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.435896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.436623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.437079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.437509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.614339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:21.629585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-50d363ef-1948-4655-8aee-ae833a88f706 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.208378 Sep 13 20:00:21.631151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 955/1910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:21.675498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:21.676425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:21.686819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.687438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.688069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.688858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.689429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.690272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.774829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:21.788434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bcda25d9-216b-42a6-bdc8-292ce80b6c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118609 Sep 13 20:00:21.789258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 956/1911] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:22.355041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.357375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.363935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.364427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.364862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.365560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.366047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.366471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.400311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2c841d48-9cc2-4fe4-9e27-a49670fc5f91 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049865 Sep 13 20:00:22.401029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 956/1912] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:22.660749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.661352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.668675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.669172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.669629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.670326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.670775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.671196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.815602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.816594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.825463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.826190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.826900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.827883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.828458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.829039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.862900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:22.872341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-511d32fa-a2f8-4f92-b5ff-890d581e9e1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.215649 Sep 13 20:00:22.872933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 957/1913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:22.902350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:22.911718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3ffaf6aa-4f88-47da-b2af-3bc9c02b3a4d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101725 Sep 13 20:00:22.912225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 957/1914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:23.416042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:23.418277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:23.426096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.426588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.427029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.427753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.428318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.428738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.472625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-acaee3cd-819a-45bc-a815-047b2e25b96a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061643 Sep 13 20:00:23.473220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 958/1915] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:23 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:23.898925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:23.899640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:23.915580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.916073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.916510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.917203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.917752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.918176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.936106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:23.936728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:23.943383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.943963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.944436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.945134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.945580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.946026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.030867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:24.041509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ae62678-2c14-4ca6-be6f-5ff521024989 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109249 Sep 13 20:00:24.042146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 959/1916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:24.100559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:24.114365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0bd6abe5-2512-4c87-9652-6e11508c3345 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.219301 Sep 13 20:00:24.115389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 958/1917] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:24.488794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:24.492108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:24.502108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.502881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.503617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.504697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:24.505453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:24.506195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.703968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8da5f826-5bf2-42bb-b409-56892e09d663 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221816 Sep 13 20:00:24.712041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 960/1918] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:24 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:25.076042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.080292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.086275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.087442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.088038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.089185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.089816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.090389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.158859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.159738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.169865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.170748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.171529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.172816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.173653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.174427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.178183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:25.188391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-81680ece-ab46-44f2-a821-0e1a3acccfb5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118433 Sep 13 20:00:25.188984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 959/1919] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:25.362289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:25.374121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8d7a6c63-36e6-49c5-958d-ba0a3830d3f4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.220952 Sep 13 20:00:25.374957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 961/1920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:25.721584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.723783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.730278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.730762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.731194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.731893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.732340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.732764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.778141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c9b0bceb-dd9a-47b3-9162-37ee53fec44a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060993 Sep 13 20:00:25.779180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 960/1921] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:26.229007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.230184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.237642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.238224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.238714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.239495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.239998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.240482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.324737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:26.339454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6983642c-6cb4-4c0a-bccb-0a3059f3f5f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116938 Sep 13 20:00:26.340470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 962/1922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:26.413643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.414701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.422857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.423336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.423775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.424467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.424912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.425338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.576813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:26.585761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9c68ba2c-0acf-4e74-9ea7-d4ca9cb9ba4a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.179127 Sep 13 20:00:26.586441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 961/1923] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:26.794742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.797216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.807603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.808468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.809145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.810304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.811038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.811741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.848577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-596239b3-d44f-4b8c-8247-9b9a574c938f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058287 Sep 13 20:00:26.849161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 963/1924] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:27.376366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.377392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.387473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.388285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.389035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.390154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.390909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.391511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.469664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:27.480672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d5941658-7c6e-4aa5-ac98-e85ddea4d902 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109190 Sep 13 20:00:27.481516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 962/1925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:27.610666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.611344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.618928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.619443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.619876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.620578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.621030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.621447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.764613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:27.772451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b5736f69-56fb-4603-90ef-e819c8433b99 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.165721 Sep 13 20:00:27.773022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 964/1926] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:27.863140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.865401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.871778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.872306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.872816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.873569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.874164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.874633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.907147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b9e24538-0e78-4844-bbb9-b7aae7b14f66 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Sep 13 20:00:27.907705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 963/1927] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:28.514296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.514913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.521489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.522008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.522440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.523323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.523877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.524925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.593137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:28.601517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1f2c562f-6d4c-4e81-ba1d-af8755db922c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092234 Sep 13 20:00:28.603115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 965/1928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:28.797787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.798469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.808058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.808656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.809437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.810710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.811437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.812170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.921822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.925216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.934488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.935370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.936077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.937033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.937843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.938451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.976516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:28.979671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:28.988078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3db0ae1-068d-4920-a6de-b5e479d3719d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071132 Sep 13 20:00:28.988663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 966/1929] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:28.990298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9063c1cd-8883-4009-88bf-8de25627a4c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.196785 Sep 13 20:00:28.990880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 964/1930] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:29.628024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:29.628863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:29.637586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.638161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.638594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.640037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:29.640695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:29.641227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.718069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:29.721844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:29.734120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-38b58b3b-22f2-45df-88b0-8ede237577b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110628 Sep 13 20:00:29.735130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 967/1931] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:30.002620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:30.004841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:30.011702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.012198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.012935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.013344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.013834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.014265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.021645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:30.022713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:30.029457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.030012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.030450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.031183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.031629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.032048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.067386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6c7a399e-2eeb-46f5-9372-279339af345f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068751 Sep 13 20:00:30.068224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 965/1932] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:29 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:30.192423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:30.206380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-50e6dc80-db01-4bee-8091-50a0f12ee87b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.190927 Sep 13 20:00:30.207401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 968/1933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:30.765644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:30.766276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:30.773977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.775164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.775671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.776448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:30.777151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:30.777837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:30.853465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:30.865400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a5531cec-f3bd-478b-8300-e4ee2e152ffb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104436 Sep 13 20:00:30.866059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 966/1934] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:31.081912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:31.084171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:31.091350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.091863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.092300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.093038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.093482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.093937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.127061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-85a9e177-3477-4cf6-9f4e-8c78d739f8df tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049759 Sep 13 20:00:31.127741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 969/1935] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:31 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:31.232684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:31.233307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:31.242202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.242843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.243362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.244140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.244649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.245108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.426125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:31.441293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9292c274-e60f-4340-9e2f-23e793da9e51 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.213695 Sep 13 20:00:31.442218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 967/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:31.897860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:31.898654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:31.907229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.907728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.908428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.909139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.909639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.910082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.983369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:31.997800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9100ec80-f23b-4ae9-b366-4d2e8399fe66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.103968 Sep 13 20:00:31.998648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 970/1937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:32.144626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:32.148435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:32.159843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.161052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.161852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.163068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.163886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.164701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.208800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-082935b2-9678-42d1-86e0-d3730f2b5f46 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071694 Sep 13 20:00:32.209491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 968/1938] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:32 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:32.481958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:32.482667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:32.493284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.494641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.495207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.496064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:32.496647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:32.497223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:32.660002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:32.670002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ceab1478-af67-48bb-9882-194c3d6ab56f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.194141 Sep 13 20:00:32.670763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 971/1939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:33.039617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:33.040726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:33.051941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.052796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.053559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.054806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.056122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.056892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.164265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:33.178807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dcfad71d-64da-4de4-850e-98eb3f323c43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.146405 Sep 13 20:00:33.179788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 969/1940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:33.223973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:33.226476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:33.229076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=90 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:33.235618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.236105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.236572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.237279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.237943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.238369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.282372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a400bf5a-5140-4f6f-b5cf-69efeea910a0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062280 Sep 13 20:00:33.283497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 972/1941] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:33 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:33.696791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:33.697408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:33.699257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=90 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:33.705345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.705889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.706422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.707118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:33.707559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:33.707974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:33.858689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:33.873827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-73df1e32-cc76-4edd-9b75-206174cfc1bd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.181067 Sep 13 20:00:33.874941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 970/1942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:34.219424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:34.220549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:34.232579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.233440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.234252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.235480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.236285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.237041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.303382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:34.307000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:34.317441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.318342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.319102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.320399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.321963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.322733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.344742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:34.357525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a08e2077-6acc-444d-a445-54845f14b097 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.145125 Sep 13 20:00:34.358550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 973/1943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:34.368735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-846251f8-62bd-444b-978e-4fcfd71c569e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072514 Sep 13 20:00:34.369364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 971/1944] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:34 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:34.916091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:34.916821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:34.927185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.927185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.927185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:34.927855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:34.928402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:34.929050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.118944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:35.131345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0109f303-8455-4cd8-b394-5a4774b2ce4d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.221236 Sep 13 20:00:35.132146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 974/1945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:35.381730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:35.384451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:35.393407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.394215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.395241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.396540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.397326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.398067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.456787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0127a7ef-9c3f-4204-80a7-4d7b19fd5c82 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079017 Sep 13 20:00:35.457717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 972/1946] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:35 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:35.499394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:35.500983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:35.511824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.512460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.513172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.514172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:35.514832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:35.515511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:35.588230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:35.596839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-616b298d-6732-435d-9a92-9605751c5a68 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.205240 Sep 13 20:00:35.597659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 975/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:36.156046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:36.156578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.163185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.163666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.164102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.165316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.165815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.166275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.355133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:36.364361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9c0b194e-2ad5-4f18-806c-ca7b3d4054ac tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.212324 Sep 13 20:00:36.365207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 973/1948] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:36.474150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:36.476623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.483578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.484060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.484492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.485180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.485710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.486183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.524626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b935b8fe-53de-499c-ae02-45d6d45d5f4a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054061 Sep 13 20:00:36.525399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 976/1949] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:36 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:36.628104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:36.628964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.635721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.636210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.636676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.637450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.638030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.638418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.722465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:36.732785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-235a0c3f-87e4-4f79-9837-e64b128cc433 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108538 Sep 13 20:00:36.733346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 974/1950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:37.389100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:37.389814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:37.397164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.397997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.398491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.399812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.400299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.400746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.541224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:37.544694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:37.552916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.553421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.553909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.554659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.555140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.555579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.592541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:37.602920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-52cad449-3cc8-41dd-acf0-939061a0baa3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.217650 Sep 13 20:00:37.603622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 977/1951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:37.606358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f763c3d7-3631-48b2-ac9d-7c48550d052e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073019 Sep 13 20:00:37.610320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 975/1952] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:37 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:37.757218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:37.757782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:37.765222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.765958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.766615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.768814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.769581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.770145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.848434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:37.863695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0c50c2fa-1dbf-4d97-ab33-06a5d2de7948 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110230 Sep 13 20:00:37.864673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 978/1953] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:38.622132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.624424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.630350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.631325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.632226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.632773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.633231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.633965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.634420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.634851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.641495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.642037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.642476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.643186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.643641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.644065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.839363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e051f8a1-81f5-4feb-bbe5-0a7347d3eeeb tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221220 Sep 13 20:00:38.840357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 976/1954] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:38.850456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.862879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-57d01931-4152-4d96-9817-3bf1493f0303 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.238780 Sep 13 20:00:38.863859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 979/1955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:38.897344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.897958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.905287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.905867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.906367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.907173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.907888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.908369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.988715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.998838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e327e64-30e4-4030-a690-c4bfea92d63b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106327 Sep 13 20:00:38.999588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 977/1956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:39.854899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:39.857822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:39.864863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.865338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.865800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.866530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.867116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.868245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.901944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:39.902376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-306346d0-650b-4eca-b0c5-df9e8fb0beff tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050962 Sep 13 20:00:39.904272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 980/1957] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:39 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:39.905389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:39.913196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.913771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.914323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.915229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.915739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.916253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.027868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:40.028937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:40.035860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.036337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.036768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.037464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.037942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.039290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.092921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.101816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6c93d558-7049-40dd-ac7f-12a278eb22ae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.205925 Sep 13 20:00:40.102620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 978/1958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:40.135095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:40.147155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4fc3d337-57e5-411a-85c8-8fd8c75270e8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.126129 Sep 13 20:00:40.147819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 981/1959] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:40.917303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:40.919530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:40.926177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.926648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.927079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.927772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.928375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.928804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.973407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-987a3fa3-47cb-4dc2-85ae-07c5c47afe47 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059939 Sep 13 20:00:40.974426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 979/1960] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:40 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:41.133387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:41.134269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:41.142418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.142898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.143328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.144027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.144505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.144945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.182245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:41.183295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:41.193842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.194738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.196160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.197428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.198270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.199073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.303428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.317876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7295947d-343f-408d-ad2c-1a05804a6eca tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.140240 Sep 13 20:00:41.319392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 980/1961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:41.322229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.330512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5bbf04e6-7e0c-4b4d-9256-8c736bfe1f44 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.201675 Sep 13 20:00:41.331262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 982/1962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:41.994902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:41.998786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:42.010309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.011170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.011929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.013090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.013551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.014011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.033793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:42.053477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d0526fc1-6144-459e-985e-17e556aebba4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066733 Sep 13 20:00:42.054225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 981/1963] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:41 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:42.347545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:42.348435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:42.360655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.361493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.362301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.363610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.364464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.365136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:42.365275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.366497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:42.377083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.377778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.378341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.379327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.380152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.380804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.478791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:42.492781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8b275d7d-a322-4ad7-a557-5ca927f90921 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.151705 Sep 13 20:00:42.493899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 983/1964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:42.887225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:42.895722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b46885df-51b5-473e-a5d3-4ec95f79438c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.537789 Sep 13 20:00:42.896298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 982/1965] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:43.071823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:43.075884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:43.086534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.087226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.087669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.088477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.089128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.090199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.119676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:43.140889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f7e7c582-affb-4c26-b4b2-644144c9cc89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077196 Sep 13 20:00:43.141419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 984/1966] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:43 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:43.522755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:43.523641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:43.532813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.533821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.534612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.535572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.536289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.536992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.628882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:43.639576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e9c08115-ea28-45ed-8581-a59f77d750b5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120566 Sep 13 20:00:43.640624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 983/1967] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:43.924605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:43.925769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:43.937311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.938194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.938961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:43.940183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:43.940972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:43.941722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.145501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.154766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-327d63a2-1699-4694-9581-cb21d9c1fbb9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.237433 Sep 13 20:00:44.155631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 985/1968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:44.159864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:44.162789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:44.173336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.173934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.174549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.175366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.176177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.176692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.220218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-43bb6542-5178-423a-b3f4-a021b54dde99 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066396 Sep 13 20:00:44.221182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 984/1969] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:44 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:44.674284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:44.675001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:44.682336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.682865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.683332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.684150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.684638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.685098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.762249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:44.773205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5ce356ad-f981-4122-8098-4fca928f92bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105311 Sep 13 20:00:44.774025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 986/1970] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:45.203491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:45.204590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:45.216023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.216887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.217697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.218690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.219358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.219789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.240501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:45.244591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:45.255699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.256303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.256812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.258265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.258915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.259470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.300309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d4906916-c3db-475a-b0ee-529c55b8eaf9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066790 Sep 13 20:00:45.300796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 987/1971] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:45 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:45.451995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.460677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-348284a2-c649-4616-aa9c-5209353b8966 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.263518 Sep 13 20:00:45.461289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 985/1972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:45.808619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:45.809777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:45.820132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.820964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.821845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.822927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:45.823655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:45.824430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:45.909256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.918517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-19f5f455-558c-4db4-947b-bbb8330b81cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117690 Sep 13 20:00:45.919178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 988/1973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:46.319066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:46.323087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:46.333071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.333836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.334442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.335628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.337255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.337934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.392662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9f00b0af-2f15-470c-9476-318dd51b081c tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079451 Sep 13 20:00:46.393718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 986/1974] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:46 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:46.485706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:46.486489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:46.493748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.494238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.494666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.495364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.495839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.496281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.654135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:46.662423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d31f9e69-9af0-48f6-8acb-3256ed169e9b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.181694 Sep 13 20:00:46.663049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 989/1975] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:46.945019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:46.945660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:46.952158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.952688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.953269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.954062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.954583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.955046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.027340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:47.041005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-eb105704-0608-49a2-aa7b-b47f0f01f0f8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100685 Sep 13 20:00:47.041834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 987/1976] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:47.411445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:47.413712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:47.420513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.420993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.421427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.422159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.422592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.423003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.455944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4ffccff-da7f-4aa9-ba1a-a60ebeae1f7f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048700 Sep 13 20:00:47.456593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 990/1977] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:47 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:47.686915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:47.687772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:47.694497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.695557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.696128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.696949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.697584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.698145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.878838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:47.888053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f573261a-b34a-4ef7-a687-659762cb2823 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.205130 Sep 13 20:00:47.888638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 988/1978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:48.070635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.071768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.083973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.084861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.086912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.088221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.088893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.089339 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.168815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:48.181861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cc39c0d7-3390-45ed-99fd-6c6701807564 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118078 Sep 13 20:00:48.182475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 991/1979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:48.470530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.472916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.480912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.481585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.482172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.483167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.483730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.484303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.522635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-287f18e6-dd45-44be-bbdf-e17c9d8e87bf tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056247 Sep 13 20:00:48.523453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 989/1980] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:48 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:48.919230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.920000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.926956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.927796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.928340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.929170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.930262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.930809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.122856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.132506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9586ecd0-3a79-425e-aa68-1d9655e6a76b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.217284 Sep 13 20:00:49.133090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 992/1981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:49.206537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:49.207827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:49.219082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.219625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.220235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.221067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.221699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.222170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.308674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:49.317988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-687b8ab3-4d93-49d4-b9ac-07bd4d3735ee tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116718 Sep 13 20:00:49.318722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 990/1982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:49.537542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:49.539885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:49.546454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.546947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.547390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.548102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.548556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.548980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.584903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-275f134c-a09a-4e8e-b2dd-fc59c75f28f4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051242 Sep 13 20:00:49.585383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 993/1983] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:49 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:50.161403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:50.162414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:50.173549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.174420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.175055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.175964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.176697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.177403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.345576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:50.346557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:50.356750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.357649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.358427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.359670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.360428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.361142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.372106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.380327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-989821a5-afb6-42e4-81ef-32ad88a96963 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.226077 Sep 13 20:00:50.381076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 991/1984] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:50.447104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.459872 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2a0a75f0-cec5-4526-89e1-32d2d95f8de1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120202 Sep 13 20:00:50.461342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 994/1985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:50.602034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:50.605426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:50.613288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.614270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.614773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.615579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:50.616059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:50.616537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:50.662437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-99efd2dd-bfe8-4343-8d11-1c52cc75bf22 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066593 Sep 13 20:00:50.663401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 992/1986] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:50 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:51.416659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:51.417810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:51.424888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.425373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.425834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.426542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.426998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.427425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.498976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:51.500070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:51.510890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.511719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.512491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.513548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.514030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.514463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.592502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.604153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9060002d-d4df-411a-81f6-6bf0b1ffbac6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112124 Sep 13 20:00:51.605386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 993/1987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:51.630421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.639646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ce2c4d93-7c24-4dc9-81b8-135c0eed7d7f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.227736 Sep 13 20:00:51.640228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 995/1988] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:51.682381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:51.685812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:51.696300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.697180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.698001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.699252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.700072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.700846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.735915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-94507052-3830-4e45-b319-d26c43ec0dd7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060851 Sep 13 20:00:51.736684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 994/1989] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:51 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:52.639059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.639934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.647279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.648382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.648994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.649869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.650426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.650988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.663304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.664036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.671125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.671608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.672047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.672741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.673188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.673630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.739843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.749168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6c8d732d-a0b1-4829-b5ae-a883e0531042 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.114006 Sep 13 20:00:52.749964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 996/1990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:52.758593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.762353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.773298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.774198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.775014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.776257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.777080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.777879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.824858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63741186-212f-4a4a-b427-9798a94cc327 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073457 Sep 13 20:00:52.825437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 997/1991] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:52.854750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.869674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-688e8415-0c4a-4798-a3c9-a315e4098842 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.209711 Sep 13 20:00:52.870719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 995/1992] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:53.788054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.789172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.796189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.796690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.797133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.797880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.798337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.798767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.838510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.840820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.847966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.848455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.848889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.849584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.850058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.850483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.875367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.889226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-89351270-df0a-4e70-b85a-93a2faeb9aff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104899 Sep 13 20:00:53.890338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 998/1993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:53.897746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.898701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.906375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5fdfa22a-0638-4cbf-9105-085e8c527cda tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072119 Sep 13 20:00:53.914749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 996/1994] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:53.915038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.915038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.915038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.915038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.915719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.915719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.084785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:54.096744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d752cbce-57c0-49c4-8e9b-f1983a8314f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.204928 Sep 13 20:00:54.097812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 999/1995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:54.920689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:54.921737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:54.925866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:54.929541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:54.932217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.933049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.933813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.935028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.935787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.936499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.940572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.941369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.942126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.943284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.943884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.944361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.995442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c39bd4f9-8367-456f-bf29-0abe5179d93d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076512 Sep 13 20:00:54.996075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1000/1996] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:54 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:55.020556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.034021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-85ecc9f9-4f50-4090-889b-ab500d1f3b38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118798 Sep 13 20:00:55.034960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 997/1997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:55.136851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:55.137479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:55.144309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.144819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.145261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.146022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.146503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.146928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.149915 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:55.312001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:55.320707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ea8bc986-62d1-4659-b0f1-a03de23970d8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.189421 Sep 13 20:00:55.321293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1001/1998] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:56.009260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:56.011691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:56.019543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.020412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.020811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.021566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.022088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.022545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.026146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:56.059811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7160d3ba-e767-45d8-a0e9-9ce0620b981d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055127 Sep 13 20:00:56.060848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 998/1999] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:56 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:56.062647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:56.063413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:56.071658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.072368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.072801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.073822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.074548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.075274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.171102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:56.181315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-af6baaeb-f7bc-4f4d-b5e7-cb3fc67a0bbb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.125487 Sep 13 20:00:56.182043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1002/2000] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:56.355819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:56.356438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:56.362721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.363210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.363792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.364487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:56.364951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:56.365444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:56.547906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:56.563295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-068fdf14-6c67-49ac-877c-25ba7616e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.212251 Sep 13 20:00:56.564377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 999/2001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:57.078822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:57.082271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:57.095739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.096716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.097899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.099747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.100613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.101819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.158716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-137704e1-5cb7-4379-8e16-541e41849233 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087653 Sep 13 20:00:57.159581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1003/2002] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:57 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:57.205069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:57.206125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:57.213472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.214138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.214789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.215624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.216191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.216754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.299951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.314620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5349d9db-c88e-44a7-9798-5de3d32b6628 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113173 Sep 13 20:00:57.315641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1000/2003] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:57.601754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:57.602710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:57.613167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.614103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.614907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.615874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:57.616851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:57.617289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:57.792033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:57.802629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-798f54de-e831-4a12-a139-2c64ed513d26 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.208212 Sep 13 20:00:57.803277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1004/2004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:58.172851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:58.175879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:58.184031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.184524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.184964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.185720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.186174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.186598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.227918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e53bcf1e-c0b8-4d8b-96bd-818ede111ac9 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059043 Sep 13 20:00:58.229054 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1001/2005] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:58 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:58.349649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:58.350535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:58.357257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.357864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.358306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.359013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.359464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.359886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.430598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:58.440596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2867b0ac-34ff-4a08-8a80-701246ca415b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094988 Sep 13 20:00:58.441266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1005/2006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:58.840646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:58.841275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:58.847785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.848368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.848811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:58.849530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:58.850065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:58.850443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.030447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.038891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-df83a724-efd0-4469-bb4f-17be6be77cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.203602 Sep 13 20:00:59.039478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1002/2007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:59.241060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:59.244114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:59.251163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.251695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.252199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.253793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.255564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.261314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.297960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e608e608-2ea5-40b8-9482-c28e47d13205 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060834 Sep 13 20:00:59.298469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1006/2008] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:59 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:59.473800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:59.474899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:59.486241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.487089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.487855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.488750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:59.489487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:59.490290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:59.585307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:59.594105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-91f22c96-7207-4b97-8e20-f29a510ecec8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.128049 Sep 13 20:00:59.594732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1003/2009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:00.066885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:00.067907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:00.075243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.075852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.076367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.077298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.077889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.078353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.241888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:00.255247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0814f6f-7a2a-4247-b613-54007f573c2b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.194921 Sep 13 20:01:00.256335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1007/2010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:00.315498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:00.318928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:00.329804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.330622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.331337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.332506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.333148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.333891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.364737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [bd1c3627-1dc1-405b-b78f-22a3e2a86642] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 20:01:00.619728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:00.620379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:00.627472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.628104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.628737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.629705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:00.630266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:00.630795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:00.705807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:00.714109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aa878421-dd07-4435-9905-d9e3abbcb901 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099289 Sep 13 20:01:00.714702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1008/2011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:01.281496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:01.282521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:01.290546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.291065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.291585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.292444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.293035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.293583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.374879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [bd1c3627-1dc1-405b-b78f-22a3e2a86642] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 54442. Sep 13 20:01:01.431383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0145354c-9de2-40c3-9f8d-5d861cf94154 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/action" status: 200 len: 41384 microversion: 2.1 time: 1.122573 Sep 13 20:01:01.432609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1004/2012] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 20:01:00 2022] POST /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d/action => generated 41384 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 20:01:01.487493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:01.502496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-413526d2-ff23-40a1-bc88-71bf10553996 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.224626 Sep 13 20:01:01.503598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1009/2013] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:01.742580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:01.743705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:01.757431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.758345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.759149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.760350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:01.761104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:01.761895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:01.838457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:01.853661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c952bd33-274a-4e5d-95e4-9a174c0dbd0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118543 Sep 13 20:01:01.854709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1005/2014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:02.544067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:02.545036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:02.553964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.554516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.555121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.555950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.556461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.556947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.756028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.769269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-082a657f-6f86-4bfc-afcb-152b2d387cf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.232346 Sep 13 20:01:02.770201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1010/2015] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:02.880321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:02.880956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:02.888904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.889453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.889984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.890732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:02.891390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:02.891887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:02.978950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:02.989474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2eb68f30-fe07-45b8-88b0-c5665565903a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113151 Sep 13 20:01:02.990341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1006/2016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:03.800550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:03.801357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:03.803883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=78 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:03.810043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.810828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.811374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:03.812242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:03.812799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:03.813333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.032849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:04.034115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:04.038517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=74 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:04.045721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:04.046189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.046439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:04.047014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.047912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:04.048528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:04.049191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:04.057180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-007d69d5-6f40-43d9-bd2f-6d5432b279be tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.260591 Sep 13 20:01:04.058159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1011/2017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:04.139550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:04.153521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-127de0f7-aaf7-4708-930b-c37aee4b9cdb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.128513 Sep 13 20:01:04.154596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1007/2018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:05.087433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:05.088570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:05.100638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.101462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.102105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.103341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.104024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.104762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.195824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:05.196882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:05.208390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.209284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.210629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.211921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:05.212718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:05.213476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:05.315080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:05.324692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7253f0e6-3456-464d-857e-5b51b125d597 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.244439 Sep 13 20:01:05.325433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1012/2019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:05.346679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:05.361328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9db963c4-40ae-4bcb-b8bb-38fce9b91bd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.172408 Sep 13 20:01:05.362082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1008/2020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:06.363271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:06.364126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:06.371145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.371877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.372603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.373426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.373988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.374615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.395610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:06.396229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:06.404343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.404964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.405590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.406351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:06.406831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:06.407521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:06.501750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.511413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34d0905e-2587-452a-9c11-823ecb3bd0a1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120231 Sep 13 20:01:06.512008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1009/2021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:06.604467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:06.615126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f61140b7-87b3-405e-9d7c-9897902b0986 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.255648 Sep 13 20:01:06.615786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1013/2022] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:07.558184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:07.559046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:07.567515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.568119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.568736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.570309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.570782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.571272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.689591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:07.702834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9e3c2e29-82b1-489f-a388-558f322a7c85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.149810 Sep 13 20:01:07.704041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1010/2023] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:07.934841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:07.937311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:07.950123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.951045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.951903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:07.953483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:07.954297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:07.955039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.018389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-55104f80-efd5-4474-ad04-3baf6f3d041f req-f8b40f4d-b182-4ef8-a773-c4059dc1d401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11000afd-6551-4b16-81dd-f5905971fb0f", "tag": "1fcd70a1-2198-49dc-8b96-511dac023c32"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:08.027046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:01:08.034970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-55104f80-efd5-4474-ad04-3baf6f3d041f req-f8b40f4d-b182-4ef8-a773-c4059dc1d401 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.035837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-55104f80-efd5-4474-ad04-3baf6f3d041f req-f8b40f4d-b182-4ef8-a773-c4059dc1d401 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.036890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-55104f80-efd5-4474-ad04-3baf6f3d041f req-f8b40f4d-b182-4ef8-a773-c4059dc1d401 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.056993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-55104f80-efd5-4474-ad04-3baf6f3d041f req-f8b40f4d-b182-4ef8-a773-c4059dc1d401 service nova] Creating event network-changed:1fcd70a1-2198-49dc-8b96-511dac023c32 for instance 11000afd-6551-4b16-81dd-f5905971fb0f on hv-cinder-82880 Sep 13 20:01:08.065598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-55104f80-efd5-4474-ad04-3baf6f3d041f req-f8b40f4d-b182-4ef8-a773-c4059dc1d401 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140904 Sep 13 20:01:08.066754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1011/2024] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:08.184464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-339a9fac-61d3-40f9-af40-398f65252545 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 204 len: 0 microversion: 2.1 time: 0.265073 Sep 13 20:01:08.185347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1014/2025] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:07 2022] DELETE /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:01:08.199409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:08.201108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:08.212863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.214308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.215476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.217134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.218339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.219456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.526602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.545274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-21f48648-851f-4e74-9b42-5c2ab787818e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1567 microversion: 2.1 time: 0.352484 Sep 13 20:01:08.546554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1012/2026] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:08.745144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:08.746584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:08.758440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.759449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.760319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.761681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:08.762621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:08.763489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:08.905647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:08.919389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-84f5ba9e-4262-48f3-a9a4-c55c316fccc6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.181777 Sep 13 20:01:08.920834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1015/2027] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:09.582946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:09.584113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:09.596382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.597225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.598160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.599328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.600696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.601515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.837375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:09.853132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7779b320-8fa7-4dcd-8bad-03a52dde5fbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.276622 Sep 13 20:01:09.854326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1013/2028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:09.957090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:09.958101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:09.965653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.966198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.966647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.967366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:09.967837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:09.968451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:09.972585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:10.102203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:10.112070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a78b9ef0-2461-4ab6-a1bd-cb7cc88336d1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.159095 Sep 13 20:01:10.112820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1016/2029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:10.893927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:10.894544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:10.904097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.904590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.905036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:10.905857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:10.906253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:10.906678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.138139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:11.139001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:11.149318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.150578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.151370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.153050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:11.153951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:11.154767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:11.306507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:11.315110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4f881b1a-c328-4ff6-99f2-05851d8ece60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.181637 Sep 13 20:01:11.316264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1017/2030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:11.379257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:11.388574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bee1c762-6514-4e7b-8456-5eb9bb6e44aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.499671 Sep 13 20:01:11.389165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1014/2031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:12.339084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:12.339721 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:12.347843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.348334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.348766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.349515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.350077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.350585 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.414140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:12.414852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:12.419053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:12.424669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.424669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.424669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.424669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:12.425179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:12.425179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:12.440674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-77d9340c-655c-41f0-9fd3-6016c4c51acf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105973 Sep 13 20:01:12.442306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1018/2032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:12.592317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:12.596128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:12.608278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9d4402bb-060c-41d8-9044-f34ad071986f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.198041 Sep 13 20:01:12.609176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1015/2033] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:13.466536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:13.468683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:13.474906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.475392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.475829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.476539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.476990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.477409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.545382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.554477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a6bf93e6-5157-44bc-9600-95a2f52ac415 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093173 Sep 13 20:01:13.555138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1019/2034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:13.633977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:13.634744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:13.642359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.642888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.643357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.644063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:13.644513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:13.644929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:13.796170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:13.805591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ffca656d-cfd7-46e8-ba8c-98ebebd290a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.175146 Sep 13 20:01:13.806322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1016/2035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:14.580885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:14.581506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:14.588351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.588842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.589497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.590241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.590696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.591121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.659880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:14.675574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-62187e0d-8600-4784-9f95-28569befbad7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098406 Sep 13 20:01:14.676607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1020/2036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:14.828513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:14.829300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:14.837570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.838020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.838461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.839185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:14.839775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:14.840346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:14.993574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:15.004997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4698afaf-0a2b-4901-ae07-8a04126b2bd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.180316 Sep 13 20:01:15.005576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1017/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:15.701265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:15.701952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:15.710036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.710764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.710969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.711678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:15.712174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:15.712570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:15.787445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:15.796882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e6657bd3-3ba4-45c7-9db1-fea6531b0e7e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099619 Sep 13 20:01:15.797459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1021/2038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:16.032108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:16.032807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:16.040671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:16.041197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:16.041738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:16.042679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:16.043347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:16.043883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:16.212860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:16.221575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-211d9789-66a7-4e38-89b2-2a6e5569fba9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193917 Sep 13 20:01:16.222214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1018/2039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:16.823255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:16.824035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:16.832146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:16.832641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:16.833085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:16.833829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:16.834349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:16.834780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:16.907814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:16.916926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d9ab1e54-7a72-4803-b471-bef2c12eb40e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098579 Sep 13 20:01:16.917518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1022/2040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:17.248612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:17.249559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:17.256785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:17.257359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:17.257858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:17.258584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:17.259044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:17.259468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:17.426448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:17.439407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e71d9bf-0a81-4824-bbde-4c18cb41db19 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.194505 Sep 13 20:01:17.440242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1019/2041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:17.942773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:17.943976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:17.951080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:17.951569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:17.952011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:17.952744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:17.953195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:17.953689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:18.051630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:18.064801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6c7b616c-d153-4738-8021-fb272a07c03b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.127340 Sep 13 20:01:18.065393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1023/2042] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:18.468221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:18.469190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:18.480296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:18.481061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:18.481817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:18.482961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:18.483707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:18.484381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:18.654226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:18.663074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d1c065ba-0023-4f97-a06a-8681e1bbf461 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.201552 Sep 13 20:01:18.663691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1020/2043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:19.102844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:19.103702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:19.110868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:19.111385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:19.111818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.112516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:19.112960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:19.113379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.187281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:19.197108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f1395729-bb87-4a85-befe-cbd8b1a5ca4c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098288 Sep 13 20:01:19.197730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1024/2044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:19.687991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:19.688692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:19.696268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:19.696756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:19.697181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.698551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:19.698551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:19.698893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:19.857389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:19.866841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-335a19a2-bfb0-46a6-a67e-e838102a2733 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.182697 Sep 13 20:01:19.867478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1021/2045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:20.225064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:20.226164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:20.235777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:20.236583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:20.237292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:20.238560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:20.239324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:20.240090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:20.318941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:20.327682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4a8ed440-c18d-48e6-8315-cf66d54babd6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109366 Sep 13 20:01:20.328270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1025/2046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:20.892392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:20.893016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:20.900839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:20.901490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:20.901710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:20.902414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:20.902863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:20.903284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.067612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:21.076550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-59719a92-4531-494b-b8ec-b471472899df tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.189687 Sep 13 20:01:21.077099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1022/2047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:21.358868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:21.359471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:21.366212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:21.366695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:21.367135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.367840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:21.368331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:21.368756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:21.435893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:21.444520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d378fbe7-630a-4a6c-b5de-3b2daf76d1bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089829 Sep 13 20:01:21.445093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1026/2048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:22.101495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:22.102174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:22.109069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.109550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.110016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.110726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.111167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.111584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.289446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.298451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a734cc2a-cb97-4688-8c93-55102cc4e330 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.202113 Sep 13 20:01:22.299179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1023/2049] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:22.468988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:22.469939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:22.477803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.478345 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.478814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.479870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.480393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.480855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.557664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.566301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2eb0df5a-2061-40cf-94dd-1f5240fdc318 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102684 Sep 13 20:01:22.566881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1027/2050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:23.324955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:23.325631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:23.337653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.338555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.339348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.340502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.341298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.342087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.495506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:23.505186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c73e82a8-07e2-48c5-8aad-efcbf64d03c7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.184588 Sep 13 20:01:23.506353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1024/2051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:23.593501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:23.594389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:23.608448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.610109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.611264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.612008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.612828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.613625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.689597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:23.697951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9f30c7e5-006e-425d-8e86-9af497b5a24c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109680 Sep 13 20:01:23.698771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1028/2052] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:24.540180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:24.541180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:24.548721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:24.549246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:24.549751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:24.550625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:24.551167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:24.551698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:24.724734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.736756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-26535a1c-162f-4cdd-a3da-b9619d85e094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.200898 Sep 13 20:01:24.737727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1025/2053] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:24.741738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:24.742602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:24.749486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:24.750001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:24.750453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:24.751148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:24.751597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:24.752019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:24.851182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.863075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2bffe20f-c645-41d1-9462-6142f34396ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.128484 Sep 13 20:01:24.869707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1029/2054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:25.771014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:25.772435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:25.783206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.783701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.784142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.784849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.785302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.785778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.892973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:25.893630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:25.901103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.901636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.902087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.902933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.903275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.903708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.960675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:25.975549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f1046839-c947-4e51-b09e-39244b2a9f30 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.211479 Sep 13 20:01:25.976812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1026/2055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:25.995600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:26.004303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-55a33b8f-62a5-4645-969f-9af48ef4fff4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.115740 Sep 13 20:01:26.004886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1030/2056] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:27.008083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:27.008680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:27.016804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.017183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.017646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.018439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.018823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.019241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.032604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:27.033212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:27.040675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.041163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.041590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.042389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.043022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.043524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.135230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.149289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3b8f24d5-9744-40d6-bdfe-714531a3df83 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120623 Sep 13 20:01:27.150075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1031/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:27.215391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.229694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-80a83747-ee1e-4509-9d5f-ad2cd543be78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.225150 Sep 13 20:01:27.230788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1027/2058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:28.174501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:28.175432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:28.182741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.183082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.183518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.184211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.184757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.185184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.254261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:28.256639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:28.256954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:28.257562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:28.263902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.264474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.264914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.265629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.266093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.266520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.267376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b12f9f27-87d7-48e1-b131-5fd43d37342d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096836 Sep 13 20:01:28.268229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1032/2059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:28.437000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:28.445787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-26466064-1754-415e-8cc7-0666f9759787 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.194806 Sep 13 20:01:28.446366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1028/2060] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:29.304839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:29.305433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:29.312466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:29.312954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:29.313379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.314179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:29.314625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:29.315040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.388275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:29.402540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8d33f6d6-9209-4f5d-8719-740a498b3e56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101728 Sep 13 20:01:29.403138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1033/2061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:29.474630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:29.475383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:29.482230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:29.482721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:29.483164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.483883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:29.484340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:29.484768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.646785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:29.659987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-67314515-ecc0-4d1e-92ae-52a832dddc36 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.192322 Sep 13 20:01:29.660573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1029/2062] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:30.435168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:30.435790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:30.442365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.443399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.443823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.444529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.444969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.445383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.514658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.522970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c57994ba-8b9b-4f43-878e-113b3ae4aa43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091696 Sep 13 20:01:30.523601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1034/2063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:30.689051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:30.689697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:30.698032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.698537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.699012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.699725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.700175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.700601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.862323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.871742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4dbf71bc-a94e-4f9c-b083-7aada6b1824b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.186500 Sep 13 20:01:30.872337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1030/2064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:31.548969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:31.549847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:31.557565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.558076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.558504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.559183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.559627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.560039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.632680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:31.640827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-86872d53-df1b-4808-97a1-dab59c5cf80b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097335 Sep 13 20:01:31.641406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1035/2065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:31.897912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:31.898521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:31.905495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.906103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.906846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.907664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.909512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.909512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:32.071008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:32.079083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4da7d985-694f-4605-bf67-6f3b04ccd24c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185846 Sep 13 20:01:32.079673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1031/2066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:32.667742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:32.670803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:32.675351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:32.675830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:32.676261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:32.677473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:32.677957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:32.678372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:32.744257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:32.752488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f187c84b-2b7c-4f83-ba28-509bc78f7959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089372 Sep 13 20:01:32.753069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1036/2067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:33.115852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:33.116666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:33.123081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.123561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.124006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.124699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.125145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.125563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.141505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:33.270774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:33.278458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-94c2c08a-b1e1-42cd-b846-8ff5b759e5af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167065 Sep 13 20:01:33.279020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1032/2068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:33.777060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:33.777696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:33.784469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.784949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.785385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.786156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.787233 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.787606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.857720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:33.865719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a620164d-7bd1-4714-adbc-e00f08930e77 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092635 Sep 13 20:01:33.866292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1037/2069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:34.303731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:34.304441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:34.307206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=52 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:34.314067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.314606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.315046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.315750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.316198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.316715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.474340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:34.483788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c22f73ca-cf39-42e4-b9e2-b2622289f9ec tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.184722 Sep 13 20:01:34.484375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1033/2070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:34.889246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:34.890035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:34.892425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:34.897889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.898380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.898817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.899572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.900035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.900421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.970983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:34.979944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a2031b0b-f791-4af3-9c35-366e587a1978 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094764 Sep 13 20:01:34.980548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1038/2071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:35.509074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:35.509810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:35.517254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:35.517866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:35.518363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.519110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:35.519562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:35.520015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.681220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:35.689565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8d5f13ff-60e2-4b10-911c-0f6cff9740a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185467 Sep 13 20:01:35.690192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1034/2072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:36.011451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:36.012468 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.023545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.024424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.025204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.026363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.026929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.027590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.098088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:36.107297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1f82fb6c-17eb-4bfb-a316-6bf869da22da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102967 Sep 13 20:01:36.107891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1039/2073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:36.716421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:36.717135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.724259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.724740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.725171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.725967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.726539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.726967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.869420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:36.882326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-32a3d24c-eb4f-4cbb-b004-7ec108aa4654 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169584 Sep 13 20:01:36.883090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1035/2074] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:37.133268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:37.133996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:37.140685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.141162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.141595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.142318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.142766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.143195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.219811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:37.233945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ecded615-ecde-4285-b774-a1e5874167da tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105248 Sep 13 20:01:37.235501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1040/2075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:37.909254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:37.910329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:37.917729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.918208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.918634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.919555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.920371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.921078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.072065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:38.083203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f0678a67-a75e-479e-b588-3f84d088f1e5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.177640 Sep 13 20:01:38.083704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1036/2076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:38.263226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:38.264084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:38.270951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.271506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.271861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.272561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.273003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.273472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.338650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:38.346863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3953112c-c851-46d3-984f-2a656918210a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087484 Sep 13 20:01:38.347442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1041/2077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:39.111134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:39.111747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:39.118880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:39.119363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:39.119799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:39.120487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:39.121048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:39.121592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:39.283029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.291422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-283822a7-c3c8-41a0-97c9-f30f461d3271 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.184158 Sep 13 20:01:39.291997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1037/2078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:39.373186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:39.374079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:39.380500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:39.380991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:39.381428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:39.382143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:39.382596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:39.383023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:39.455540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.464337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-09be7355-cecb-4556-89dc-a7cdff885c66 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095011 Sep 13 20:01:39.464921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1042/2079] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:40.315181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:40.315904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:40.324243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.324727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.325160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.325882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.326330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.326747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.470620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.479975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c150da36-601f-4ac7-9efe-f7bf63532c80 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.168756 Sep 13 20:01:40.480551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1038/2080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:40.489941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:40.490620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:40.498131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.498901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.499471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.500477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.501286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.502026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.586633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.595711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b89db983-d977-439c-9c5d-bdbfaf31f43d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.111669 Sep 13 20:01:40.596612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1043/2081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:41.505239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.505931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.512666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.513164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.513623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.514344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.514792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.515214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.627280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.628008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.636000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.636490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.636917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.637654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.638108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.638695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.673420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.682436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cc2db2ca-2882-4cab-938e-01649f738cc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.181637 Sep 13 20:01:41.683013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1039/2082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:41.706833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.715109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-220be73c-e2fe-4842-a01f-7e0e29ff0999 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091881 Sep 13 20:01:41.715699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1044/2083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:42.706919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:42.708084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:42.714970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.715454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.715886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.716590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.717034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.717454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.737552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:42.738226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:42.745120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.745672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.746055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.746809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.747204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.747629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.838691 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:42.850395 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b5e054bf-30fa-4e97-a30d-297eed00caff tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116282 Sep 13 20:01:42.851118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1045/2084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:42.892676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:42.901874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9c38ff31-a5d5-4cea-b54f-be56141a56a7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.198608 Sep 13 20:01:42.902463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1040/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:43.875479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:43.876174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:43.885488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.886810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.886810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.888141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.888141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.889027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.929874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:43.931080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:43.940238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.940914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.941582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.942787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.943779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.944318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.974330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:43.985908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1e22603c-a666-4f3d-80b3-d7d9ed0b7f9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.114085 Sep 13 20:01:43.986566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1046/2086] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:44.107104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:44.116084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2a9bbc11-ef26-423d-aa3e-44d1288587f7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193045 Sep 13 20:01:44.117079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1041/2087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:45.009870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:45.010541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:45.017264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.017776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.018207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.018893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.019435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.020992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.088556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.096268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f0fa0137-57c7-4ed9-af5e-cac7621d5b0c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091233 Sep 13 20:01:45.096871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1047/2088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:45.156396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:45.157006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:45.164167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.164640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.165072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.165796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.166232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.166654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.305279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.314164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0b04d916-71c7-4a09-a43c-ffcf7ffd8067 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162016 Sep 13 20:01:45.314886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1042/2089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:46.120499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:46.121130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:46.129056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.129556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.130010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.130717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.131149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.131633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.196308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.205816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0a0e9021-17e7-4722-87ac-e0d00a048a29 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089138 Sep 13 20:01:46.206442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1048/2090] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:46.338931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:46.339547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:46.346429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.346909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.347342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.348027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.348472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.348889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.496637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.505797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ad1c7f6-dc55-4086-8b67-9f6ac1cdb93c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170675 Sep 13 20:01:46.506375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1043/2091] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:47.230387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:47.230983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:47.237307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.237822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.238261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.238961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.239414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.239846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.255751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:47.310083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:47.318658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-85500c6b-4bce-4251-8ad8-10f0a2fb5dd2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092190 Sep 13 20:01:47.319248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1049/2092] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:47.528887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:47.529475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:47.536249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.536730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.537163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.537879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.538327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.538748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.679526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:47.687627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2cb356ed-cf9b-4ba6-a772-5b5bf79014f9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162692 Sep 13 20:01:47.688272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1044/2093] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:48.347011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:48.347908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:48.354833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.355316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.355745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.356446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.356893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.357503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.426783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:48.435219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4809c774-162d-435c-9e0b-dff38e66b276 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094826 Sep 13 20:01:48.435840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1050/2094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:48.712827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:48.713465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:48.720282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.720776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.721216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.721955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:48.722404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:48.723328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:48.865316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:48.872968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-af3bf627-445e-4ed2-81a7-79b0df1a8fb4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164132 Sep 13 20:01:48.873767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1045/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:49.460094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:49.460705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:49.467598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.468089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.468527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.469238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.469717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.470146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.542404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:49.551853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3dafab3e-31ef-443a-a18f-ec0d6fd794ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096460 Sep 13 20:01:49.552543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1051/2096] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:49.897989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:49.898920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:49.905537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.906356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.906761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.907558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.908013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.908455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.074228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.085394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7aeddc40-8745-45b4-aa20-fc6898b9d506 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.191260 Sep 13 20:01:50.086095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1046/2097] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:50.576560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:50.577277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:50.583757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.584241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.584687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.585375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.585878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.586303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.648103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.656534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-aeb8ef46-bc0a-4d19-90b5-8be325c79643 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083526 Sep 13 20:01:50.657346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1052/2098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:51.109535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.110214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.117014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.117501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.117978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.118698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.119152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.119580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.256369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:51.265361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-93dc20b0-3699-4112-ae73-ee549491c254 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159651 Sep 13 20:01:51.265985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1047/2099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:51.679977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.680587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.688034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.688619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.689156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.690039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.690649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.691080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.759428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:51.770891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1ad2f584-1d01-4666-aebc-f0d66dc7a940 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093852 Sep 13 20:01:51.771857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1053/2100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:52.293448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:52.294373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:52.302457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.302947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.303384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.304083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.304536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.304961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.462252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:52.470197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c5d50e7a-914d-460c-b1e0-74c441b6dc2c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.181299 Sep 13 20:01:52.470786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1048/2101] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:52.795664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:52.796275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:52.803254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.803717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.804188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.804892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.805926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.806072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.874952 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:52.883057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-24515d1d-bf64-474b-895a-9f53133f6ab7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091910 Sep 13 20:01:52.883662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1054/2102] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:53.493910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:53.494540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:53.501093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.501732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.502174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.502869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.503319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.503794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.506584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:53.647571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.655389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9d352f21-97fe-48da-a708-417b28df62f0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165567 Sep 13 20:01:53.656382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1049/2103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:53.907249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:53.907860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:53.914528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.915005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.915435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.916119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:53.916570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:53.916984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:53.984156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.992609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f70d070f-285d-4f17-8cc9-a8f5bc89f867 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089677 Sep 13 20:01:53.993250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1055/2104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:54.683700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:54.684881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:54.696874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.697811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.698601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.699864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.700691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.701474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.844365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:54.853536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-09d34784-6cee-49cf-9d37-35dbba36fb9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176199 Sep 13 20:01:54.854215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1050/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:55.017319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:55.017922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:55.024580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.025066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.025504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.026218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.026670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.027086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.090203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.098216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8ecae60d-f41c-443c-bab0-6e257da9f154 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084936 Sep 13 20:01:55.098781 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1056/2106] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:55.879722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:55.880335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:55.886928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.887402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.887841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.888530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.888978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.889399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.024368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.032925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cb08fdaa-16d8-4e9c-ad97-1a517302bcfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158111 Sep 13 20:01:56.033725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1051/2107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:56.122922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:56.123671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:56.129858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.130275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.130706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.131405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.131849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.132275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.198567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:56.206776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f4451225-f643-4c7f-98be-b4b3067516f6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088121 Sep 13 20:01:56.207353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1057/2108] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:57.058773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.059376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.067321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.068149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.068906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.070179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.070941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.071694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.216703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.224574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fea8ccb7-e3a5-4938-84b8-89e917e02fc8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.171141 Sep 13 20:01:57.225142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1052/2109] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:57.230010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:57.230616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:57.237790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.242243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.242243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.242243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:57.242243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:57.242892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.311743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.320448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b7b16bd9-0ad6-453c-bff9-2b6e4fd67ee3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094508 Sep 13 20:01:57.321080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1058/2110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:58.249441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:58.250193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:58.257285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.257890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.258324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.259014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.259453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.259869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.347832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:58.348945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:58.360630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.361679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.362670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.364176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:58.365216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:58.366023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:58.441836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:58.450896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-66efd64d-d207-4671-b79d-a203f1fb85e2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.205290 Sep 13 20:01:58.451680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1053/2111] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:58.459494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:58.473586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bffd5a68-9a19-48e3-991c-faf838c05c6a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.132503 Sep 13 20:01:58.474650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1059/2112] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:59.478860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.479480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:59.486352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.486881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.487351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.488199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.488684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.489144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.497172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.498125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:59.504571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.505046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.505473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.506209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:59.506652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:59.507072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:59.598478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.608496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29fe4e66-d43f-4a35-ae94-5ff917d12d85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.115520 Sep 13 20:01:59.609089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1060/2113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:59.670342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:59.678772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-480db3f2-2bd7-4835-b588-f579b50f152e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.203717 Sep 13 20:01:59.679358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1054/2114] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:00.636871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:00.637519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:00.644985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.645544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.646207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.647235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.647870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.648584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.704746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:00.705765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:00.713588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.714265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.714800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.715594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:00.716201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:00.716722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:00.730380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:00.740262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-49d0c7db-bed5-4b67-82a9-48d75e472f75 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.107628 Sep 13 20:02:00.740854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1061/2115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:00.867426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:00.881902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6cf8bb9c-ad6c-49b3-8512-369b088c6ff7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.181998 Sep 13 20:02:00.882912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1055/2116] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:01.772644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:01.773261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:01.779817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.780300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.780990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.782243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.782243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.782622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.856761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:01.866533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e71fbb3a-852e-4238-a860-a4eea2f725fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097621 Sep 13 20:02:01.867132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1062/2117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:01.919404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:01.920515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:01.931641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.932391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.933066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:01.934190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:01.934884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:01.935530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.126161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:02.135294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-896f3c8c-a898-4988-abc4-79f57d09dcc4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.223005 Sep 13 20:02:02.135949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1056/2118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:02.891320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:02.891925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:02.899700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.900302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.900738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.901433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:02.902028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:02.902533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:02.974786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:02.982892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a828e699-560a-4bd8-a0ec-8e1e625fa031 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095420 Sep 13 20:02:02.983472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1063/2119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:03.160536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:03.161214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:03.167658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:03.168137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:03.168577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.169263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:03.169744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:03.170181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:03.335333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:03.344468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ca89dce0-5e83-4c28-ae09-3ce25b3b7eea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.188731 Sep 13 20:02:03.345187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1057/2120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:04.012417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:04.013235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:04.030217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.031287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.031866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.032593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.033276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.033826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.105264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.117059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-95a1f2d2-56bc-40b1-9658-b474468f6d45 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.111819 Sep 13 20:02:04.117690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1064/2121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:04.369756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:04.370503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:04.372644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=50 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:04.377982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.378462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.378897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.379583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:04.380026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:04.380441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:04.543441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:04.552248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d9e308eb-af73-4f50-8ed8-5275353039a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.186558 Sep 13 20:02:04.552845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1058/2122] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:05.142871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:05.143471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:05.146437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=54 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.152062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.152539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.152966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.153677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.154122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.154539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.233842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:05.242040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-66082b29-6cb8-4fa2-b7ef-3bd8250a76bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105366 Sep 13 20:02:05.242774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1065/2123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:05.576070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:05.576897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:05.583859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.584346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.584784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.585474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:05.585972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:05.586371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:05.729855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:05.738229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-92177a83-c40b-49cf-8483-4466bd85d232 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165970 Sep 13 20:02:05.738873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1059/2124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:06.265309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:06.265903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:06.272988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.273473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.273938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.274632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.275081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.275499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.278380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.345328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:06.362158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cf781b67-c5cd-4a57-8753-0bd7b74096b4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100684 Sep 13 20:02:06.362768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1066/2125] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:06.843501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:06.844357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:06.851626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.852216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.852668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:06.853400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:06.853862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:06.854299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.007490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:07.019677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5445e58e-ddd8-43fc-9a89-639342dc62b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.262105 Sep 13 20:02:07.020552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1060/2126] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:07.388390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:07.388992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:07.396297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.396779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.397210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.397938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:07.398460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:07.398460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:07.468767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:07.477948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e64ed3cd-7ea0-404b-ac2a-c7b9c5664182 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093438 Sep 13 20:02:07.478549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1067/2127] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:08.046978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:08.048035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:08.058623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.059178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.059626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.060339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.060796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.061226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.207795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:08.215609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-195cbee4-982d-4053-9f23-ef175647a975 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.175069 Sep 13 20:02:08.216173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1061/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:08.504846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:08.505919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:08.513416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.513930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.514389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.515082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.515527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.515946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.578695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:08.587027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-24784dbd-6a26-4e83-b022-9a5a9023ec3d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088549 Sep 13 20:02:08.587594 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1068/2129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:09.239755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:09.240527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:09.248069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.248563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.248996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.249714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.250179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.250599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.391728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:09.399722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-87861d91-69fe-4254-9489-056c010befd7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164363 Sep 13 20:02:09.400296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1062/2130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:09.611127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:09.611784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:09.618979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.619465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.619896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.620588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:09.621031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:09.621462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:09.685747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:09.702189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-858f17a5-9aeb-4f64-b24a-e977b765ec6c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094889 Sep 13 20:02:09.702787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1069/2131] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:10.425417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:10.426084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:10.435125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.435991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.436745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.438028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.438845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.439605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.609579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.618625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6657c29a-2975-420e-88f2-c514697a1859 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.197274 Sep 13 20:02:10.619240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1063/2132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:10.725704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:10.726336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:10.733754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.734380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.735028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.735957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.736554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.737704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.816542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.826524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f6031faa-afef-46ff-8d6b-146d51543959 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104856 Sep 13 20:02:10.827101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1070/2133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:11.643886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:11.644712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:11.654284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.654771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.655212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.656169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.656632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.657113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.851095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:11.851898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:11.859049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.859591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.860070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.860800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.861402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.861857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.960410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.969271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.974680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ecc92876-f56f-4b95-a557-2be7046be184 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.128683 Sep 13 20:02:11.975694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1071/2134] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:11.991129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a33f9c83-2418-4da6-95ab-8e4f35a1e8ce tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.351351 Sep 13 20:02:11.991713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1064/2135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:12.999905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:13.000686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:13.008696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.009288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.009867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.010701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.011175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.011875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.015930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:13.016758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:13.027636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.027636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.027636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.027636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.028746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.028746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.127902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.136549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1a5db03f-f7d3-4de4-a373-c56eaa6e607f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.140683 Sep 13 20:02:13.137504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1072/2136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:13.226534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.229504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:13.241459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-219dbc0b-7c97-45aa-85c4-2a43f23de2f5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.230792 Sep 13 20:02:13.242501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1065/2137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:14.162939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:14.163566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:14.170543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.171034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.171473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.172177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.172631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.173053 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.249106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.261421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-96504199-90ef-45ee-a12b-579829cb6965 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102443 Sep 13 20:02:14.262187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1073/2138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:14.282894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:14.283526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:14.290934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.291416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.292014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.292885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.293467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.293924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.451134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.461000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-76c7aa71-68ac-4a75-9021-f80d271489af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185262 Sep 13 20:02:14.461630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1066/2139] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:15.291690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.292252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.299037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.299544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.299978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.300675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.301124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.301542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.367279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:15.381050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e66e851c-3aac-4f9f-bd21-e4d9e166792e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093192 Sep 13 20:02:15.382153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1074/2140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:15.492823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.493552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.500239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.500734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.501170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.501894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.502345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.503278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.653353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:15.662756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7ca697f8-cf04-487b-8726-578f7937bdbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.174048 Sep 13 20:02:15.663333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1067/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:16.414063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:16.415089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:16.425603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.426174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.426616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.427318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.427769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.428195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.508847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:16.520962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-10069617-4946-434b-9ef8-c95c7393c60f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113254 Sep 13 20:02:16.522063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1075/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:16.690715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:16.691573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:16.698815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.699310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.699750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.700470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.700925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.701354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.867169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:16.880488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f6962d7b-d074-439f-9012-77ed10c87726 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.197244 Sep 13 20:02:16.881392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1068/2143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:17.546130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:17.546862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:17.553584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.554112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.554571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.555265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.555714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.556138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.635084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:17.644320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6bd40a27-864a-4b1d-ad8b-145310981198 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102286 Sep 13 20:02:17.644985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1076/2144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:17.904916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:17.905815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:17.914904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.915705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.916496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.917739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.918549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.919258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.070101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.078158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-71ec27e7-558f-473a-b786-d347a44fa145 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.177475 Sep 13 20:02:18.078748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1069/2145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:18.670131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:18.671192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:18.678805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.679296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.679749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.680433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.680887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.681303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.751929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.760657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-04c1f17a-8842-4ce2-9440-1e6ffeaeb356 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095389 Sep 13 20:02:18.761236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1077/2146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:19.102195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:19.103051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:19.109721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.110215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.110653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.111351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.112306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.112742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.255853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.263981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d4b1a8f1-aee3-4c47-9ad4-539c72c1f54a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165707 Sep 13 20:02:19.264561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1070/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:19.787035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:19.787697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:19.795881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.796439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.796970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.797835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.798329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.798909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.872904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.881600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b0b78426-8828-493d-9752-328f96bf2d43 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100111 Sep 13 20:02:19.882334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1078/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:20.288525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:20.289076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:20.296016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.296513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.297001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.297950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.298716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.299803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.457687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:20.466454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de75ae09-4baa-4f9b-8ed7-7550629ca429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.182623 Sep 13 20:02:20.467014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1071/2149] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:20.906181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:20.906917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:20.914435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.914917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.915344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.916058 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.916551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.917030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.987054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:20.995047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8c55dabc-2045-4503-9242-4cfefeae3897 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093353 Sep 13 20:02:20.995927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1079/2150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:21.491428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:21.492056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:21.498876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.499434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.499871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.500570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.501018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.501441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.654762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:21.668201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2544b381-d0b2-4690-993a-ab876958a19c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.180956 Sep 13 20:02:21.669077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1072/2151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:22.020401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:22.021067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:22.027804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.028285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.028724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.029493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.030283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.030884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.096987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.105304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-26671bd3-5408-4c0a-b726-dab25c928daf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090167 Sep 13 20:02:22.106077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1080/2152] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:22.693256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:22.694146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:22.701627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.702467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.703022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.703709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.704202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.704631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.861252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.874909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e8468263-a75d-4a49-9f27-311fbfdba1c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185808 Sep 13 20:02:22.875924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1073/2153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:23.133936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:23.135076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:23.143835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.144311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.144747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.145462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.145916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.146337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.217330 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:23.226564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-51b6f3a9-1d8f-46ff-be9d-0b2b0b20fea3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099879 Sep 13 20:02:23.227151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1081/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:23.899269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:23.900272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:23.909676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.910165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.910607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.911304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.911761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.912185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.073435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.081693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-15a857d8-a4d1-4d3f-b842-bd54760f1b22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.186477 Sep 13 20:02:24.082262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1074/2155] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:24.251615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:24.252466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:24.259595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.260079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.260519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.261200 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.261716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.262102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.335650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.337876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:24.344948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-19c2a1eb-abdc-4c46-8195-d82205809073 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098368 Sep 13 20:02:24.345513 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1082/2156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:25.106168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.107534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.114385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.115134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.115565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.116543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.117067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.117754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.285515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.298354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1433b65e-f578-4b7b-821f-4c009431da29 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.196002 Sep 13 20:02:25.298976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1075/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:25.368675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.369470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.371540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:02:25.371731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b (ip 10.222.0.23) !!! Sep 13 20:02:25.380743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.381537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.382318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.383379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.383883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.384347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.476635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.489423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-305246a6-df9d-400b-9bd5-68b8b713d70b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.125206 Sep 13 20:02:25.490046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1083/2158] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:26.330631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:26.331438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:26.338793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.339285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.339732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.340572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.340998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.341431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.513482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:26.514557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:26.521227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.522341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.522834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.523269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.524031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.524488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.525234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.534232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dffcca92-0277-4984-bc8f-8626f3d88339 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.214061 Sep 13 20:02:26.535447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1076/2159] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:26.619831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.629552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bad8b032-a29e-4a68-9a74-63aca3cc6425 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120502 Sep 13 20:02:26.630654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1084/2160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:27.567585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:27.568240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:27.574857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.575339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.575768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.576461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.576899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.577332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.665133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:27.675289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:27.688047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.688533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.688978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.690215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.690666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.691083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.734980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.745482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e7ef4b9-635b-486e-b3b8-0e5200f7fb38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.181932 Sep 13 20:02:27.746114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1077/2161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:27.777527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.790951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1a6165b3-780f-4457-8881-e8107dbbb3c5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.131305 Sep 13 20:02:27.791524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1085/2162] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:28.789967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.790708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.797473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.797998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.798435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.799243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.799696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.800141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.817527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.818239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.825369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.826153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.826719 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.827576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.828375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.829137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.927014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.942182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f0078c99-1e25-415f-b3ad-21c2920ed013 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.130059 Sep 13 20:02:28.942848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1086/2163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:29.004278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:29.012647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-33b0c3dc-ee97-41a8-b485-301402488104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.226810 Sep 13 20:02:29.013249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1078/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:29.974609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:29.975619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:29.982868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.983412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.983890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.984642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.985185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.985748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.049880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:30.051085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:30.058661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.059341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.059887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.060743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.061249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.062072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.083043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:30.094170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-76addf93-6cd1-4277-9f2a-d8580d9c0d90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.124350 Sep 13 20:02:30.094772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1087/2165] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:30.271418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:30.284462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2e4838c6-bf48-49bf-bf1f-7632bc5b389a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.240203 Sep 13 20:02:30.285153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1079/2166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:31.126144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:31.126790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:31.135553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.136381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.137268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.138519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.139307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.140054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.312871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:31.315059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:31.326503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.327223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.327899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.329057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.330180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.330927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.514550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:31.528662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d68ff110-1acb-49bd-95d8-b296b3429ea8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.406293 Sep 13 20:02:31.529266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1088/2167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:31.638417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:31.647525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a3a840ca-09cb-4ebe-bd09-b22e567dd276 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.342355 Sep 13 20:02:31.648128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1080/2168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:32.565847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:32.566412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:32.574517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.575163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.575766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.576557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.577100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.577669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.652954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.661317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f7f8b11-efbb-48a7-be2d-2ca1df7da552 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100183 Sep 13 20:02:32.661973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1089/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:32.676440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:32.677347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:32.687729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.688427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.689989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.690981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.691745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.692545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.849569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.859523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-373895be-dd3d-4c58-8d1f-cd426751a60b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.189685 Sep 13 20:02:32.860132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1081/2170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:33.684999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:33.685753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:33.695502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.696340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.697107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.698350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.699227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.700041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.774348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:33.783905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fdf9960c-7c9d-4be5-9053-034dd17a3de4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102840 Sep 13 20:02:33.784552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1090/2171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:33.888579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:33.889542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:33.900931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.901804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.902541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.903712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.904488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.905498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.937410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.099625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.113796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-df9d793c-da34-43e9-81c9-01dd1aa9bd82 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.232031 Sep 13 20:02:34.114834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1082/2172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:34.807776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:34.808370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:34.815773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.816251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.816697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.817358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.817834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.818247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.883022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.891277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fec70315-f5e4-4abf-a4e9-546e658d6d28 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087306 Sep 13 20:02:34.891853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1091/2173] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:35.140985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:35.142064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:35.145108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=50 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:35.150711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.151215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.151660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.152386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.152970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.153274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.298842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:35.306935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a33e2bbe-5bfc-4097-8262-ac74d093c789 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170588 Sep 13 20:02:35.307508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1083/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:35.915811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:35.916461 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:35.918809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=54 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:35.924819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.925309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.925787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.926490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.926937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.927364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.993945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.002327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e4a4e71e-64bd-484c-935e-ddfd85058ede tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090712 Sep 13 20:02:36.002902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1092/2175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:36.331843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:36.332456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:36.339947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.340436 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.340873 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.341565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.342037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.342484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.504596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.513670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fce90d9a-ead1-40f3-a05f-19c65487081c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.186301 Sep 13 20:02:36.514268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1084/2176] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:37.024347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:37.024962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:37.032060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.032593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.033028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.033757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.034204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.034625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.099577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:37.107711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-806039d2-6db9-42ab-ba65-80aa492ed6f3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087166 Sep 13 20:02:37.108251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1093/2177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:37.538328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:37.539086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:37.545864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.546354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.546793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.547500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.547969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.548419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.727342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:37.739014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3668aaeb-4cf4-49bd-a68c-13786e911549 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.204530 Sep 13 20:02:37.739602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1085/2178] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:38.131420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:38.132504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:38.138758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.139241 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.139682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.140391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.140845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.141266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.210093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.218104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0e5f4fba-e3e7-4341-b22f-f0c5118bde82 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090425 Sep 13 20:02:38.218584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1094/2179] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:38.765693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:38.766311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:38.774014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.774865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.775320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.776018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.776473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.776909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.935892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.944645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b0458837-596e-4800-95b7-3aab2e426047 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.182851 Sep 13 20:02:38.945204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1086/2180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:39.244072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:39.244850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:39.252329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.252839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.253292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.254073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.254865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.255506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.330443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:39.339281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ec749fa1-9345-46b1-afb7-89217db39ade tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099721 Sep 13 20:02:39.339887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1095/2181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:39.969164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:39.969164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:39.976389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.976886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.977326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.978068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.978524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.978953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.132924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.141012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-985fbe9e-f59d-4412-910b-026f24dde43c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176506 Sep 13 20:02:40.141599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1087/2182] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:40.363144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:40.364040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:40.370354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.370835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.371272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.371979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.372428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.372847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.441724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.450718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b98ea600-0227-4aa3-8f21-fffba8a4d379 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091608 Sep 13 20:02:40.451303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1096/2183] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:41.165912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:41.166796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:41.168607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:02:41.168812 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:02:41.176075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.176556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.176989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.177721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.178176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.178593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.328889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:41.340490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-380bc8a1-6719-459f-9758-3b671b04a3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.178985 Sep 13 20:02:41.341230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1088/2184] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:41.474178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:41.474801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:41.481871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.482357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.482820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.483474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.483921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.484337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.551784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:41.559936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c9770360-a99e-4791-a577-c8e6c4e2b3d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089550 Sep 13 20:02:41.560567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1097/2185] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:42.368190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:42.369161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:42.379033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.379822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.380552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.381755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.382549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.383263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.549219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.566724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3bdbb617-8fbb-46fa-8d62-4e66f6be30a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.202186 Sep 13 20:02:42.567784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1089/2186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:42.588107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:42.588799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:42.591353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:02:42.591550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:02:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b (ip 10.222.0.23) !!! Sep 13 20:02:42.603595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.604076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.604511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.605193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.605660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.606124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.677133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.686234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5ab4f4e5-a380-4d02-a51a-5892f0ebaf5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101923 Sep 13 20:02:42.686809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1098/2187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:43.606297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:43.606925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:43.614104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.615056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.615056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.615852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.616260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.616735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.711269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:43.712255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:43.721195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.721709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.722425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.723263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.723709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.724129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.749490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:43.778045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.787358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-14d2b40f-0e25-4c7b-8b19-07b7b946c7e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185230 Sep 13 20:02:43.787965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1090/2188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:43.811368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.820576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-25a51167-2db3-4673-ae7a-a81b1079e8ea tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113843 Sep 13 20:02:43.821159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1099/2189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:44.814548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:44.815545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:44.826343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.827145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.827867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.829649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.830417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.831141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.849141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:44.850250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:44.860795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.861583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.862346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.863502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.864258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.864953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.974552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:44.986755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c08e5a8c-930a-47ed-8e38-f06dca42b969 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.144497 Sep 13 20:02:44.987774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1100/2190] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:45.059345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:45.069038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8a18e2ae-d818-469d-b693-bf163d702499 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.261020 Sep 13 20:02:45.069555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1091/2191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:46.012162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:46.013320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:46.023644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.024074 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.024550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.025294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.025826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.026249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.097409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:46.098587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:46.099026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:46.107249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1d5ff0c0-47da-45dc-9899-4017ffb3023f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099880 Sep 13 20:02:46.107842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1101/2192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:46.109531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.110932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.111676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.112910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.113741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.114500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.267718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:46.276044 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f3f12937-4afc-4dd3-96c0-a3a1021ba348 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.186110 Sep 13 20:02:46.276627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1092/2193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:47.135108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:47.135705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:47.142616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.143104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.143539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.144232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.144689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.145108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.214446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:47.228934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4bb669b7-be41-48e7-b4ba-93efc559ca76 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097439 Sep 13 20:02:47.229989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1102/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:47.305722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:47.306405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:47.312813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.313429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.314203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.315175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:47.315834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:47.316257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.492340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:47.501776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-896f6945-12d8-442c-83fa-14055a3d884f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.200086 Sep 13 20:02:47.502459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1093/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:48.265148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:48.266046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:48.276888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:48.277789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:48.278572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.280028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:48.280841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:48.281596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.367678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:48.376985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f5b4d736-083e-44aa-9203-7cfefe569fb9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.118306 Sep 13 20:02:48.377573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1103/2196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:48.526130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:48.527117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:48.536628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:48.537503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:48.538319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.539562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:48.540382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:48.541169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:48.700517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:48.711674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8f56467e-b758-4991-8294-e75bd58e24c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.189892 Sep 13 20:02:48.712348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1094/2197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:49.403500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:49.404635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:49.412081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.412758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.413364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.414361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.414852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.415319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.509219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:49.517265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-94596863-50e2-4479-abaf-456794ce4757 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.119960 Sep 13 20:02:49.517906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1104/2198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:49.735400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:02:49.736162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:02:49.740453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:49.741123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:49.748176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.748730 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.749163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.749946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:49.750445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:49.750862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:49.956686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:49.973229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f9f65419-a12a-48ca-893e-4f2399ce9b38 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.239042 Sep 13 20:02:49.975095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1095/2199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:50.541209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:50.542354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:50.550581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:50.551102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:50.551565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:50.552271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:50.552792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:50.553524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:50.628525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:50.637165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-46ce35c6-b476-411d-be34-0c10c00fb547 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099746 Sep 13 20:02:50.637998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1105/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:50.998752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:50.999734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:51.007407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:51.007894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:51.008332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.009102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:51.009555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:51.010438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.190668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:51.205810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6ec2bfab-57d7-45af-9b6e-8db11e5e3323 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.210734 Sep 13 20:02:51.207099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1096/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:51.664498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:51.665151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:51.673687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:51.674489 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:51.675246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.676487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:51.677285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:51.678064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:51.754353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:51.767895 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-919fc008-96bd-4d05-94bf-38b0327d94ab tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.109469 Sep 13 20:02:51.768889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1106/2202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:52.243499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:52.244364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:52.250761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.251316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.251804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.252565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.253063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.253556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.414132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:52.423288 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5e66ea70-f2e7-4a62-905c-aaa2b30ebf8c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.183836 Sep 13 20:02:52.424010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1097/2203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:52.804480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:52.805128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:52.811733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.812211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.812649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.813947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:52.814399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:52.814820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:52.882248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:52.893362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5d67a61b-932b-4458-9b53-6abe6089071a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092564 Sep 13 20:02:52.894095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1107/2204] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:53.452844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:53.453588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:53.461222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.461800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.462302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:53.463072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.463605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.464069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:53.629113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:53.639105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9913248d-1bbd-45e4-baf3-e704ad690ce1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.192790 Sep 13 20:02:53.639683 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1098/2205] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:53.930281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:53.930906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:53.939130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.939736 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.940258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:53.941035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:53.941729 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:53.942222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:54.008174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:54.016643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-12d22970-1657-424c-978d-8d70009b71de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090207 Sep 13 20:02:54.017226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1108/2206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:54.663695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:54.664446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:54.671204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:54.671680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:54.672134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:54.672820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:54.673267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:54.673716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:54.676349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:54.820577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:54.829030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2652ce36-a531-4cbf-8d38-ea5b2c5d1f56 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.168884 Sep 13 20:02:54.829641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1099/2207] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:55.039537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:55.040137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:55.047444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.047936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.048376 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.049083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.049536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.049994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.126066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:55.137034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f9cc74f1-afb4-483f-b539-ea393e737d8e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101301 Sep 13 20:02:55.137726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1109/2208] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:55.853180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:55.853989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:55.862160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.862691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.863208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:55.864208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:55.864870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:55.865493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:56.042170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:56.051373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a7210b00-ab1d-43ad-9a8b-571e17289b2e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.202222 Sep 13 20:02:56.051965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1100/2209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:56.161111 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:56.161798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:56.171689 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:56.172590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:56.173367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:56.174631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:56.175473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:56.176223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:56.256316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:56.264480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eb4a42fb-f67d-4444-9cf3-364a0edd271a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.107877 Sep 13 20:02:56.265067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1110/2210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:57.076337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:57.076947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:57.086203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.086742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.087188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.087885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.088343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.088769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.229642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:57.238682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4bcaf715-2845-4a94-8bb9-a98e9ad3da84 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.166413 Sep 13 20:02:57.239252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1101/2211] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:57.297888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:57.298938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:57.309660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.310157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.310593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.311288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:57.311745 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:57.312168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:57.377862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:57.386477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-287e41d0-9c9c-4158-bfe5-7986b2741cd7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096432 Sep 13 20:02:57.387049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1111/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:58.263136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:58.263721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:58.270551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.271110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.271626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.272352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.272915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.273378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.411593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:58.412425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:58.419312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.419571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.420134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.420934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:58.421175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:58.421572 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:58.429201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:58.440836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-26a7d054-9fab-4f34-aee5-6f7314f9ed97 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.181693 Sep 13 20:02:58.441662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1102/2213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:58.492152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:58.506422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1e2dd8c8-0cea-4bb7-86ee-4297bbb0eaac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098409 Sep 13 20:02:58.507439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1112/2214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:59.466905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:59.467633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:59.475459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:59.476009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:59.476370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:59.477069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:59.477647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:59.477964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:59.528862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:59.529821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:59.537772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:59.538434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:59.538937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:59.539463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:59.539857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:59.540254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:59.627601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:59.639299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-42f48cb0-171a-4a8a-868b-1245793afc90 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113875 Sep 13 20:02:59.640338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1113/2215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:59.683202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:59.691496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-074970d6-2414-4c6a-8e29-56b3bf883e8b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.228702 Sep 13 20:02:59.692102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1103/2216] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:00.674563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:00.675415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:00.682708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.683187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.683619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.684299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.684750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.685166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.719120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:00.719726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:00.726669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.727146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.727577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.728261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:00.728705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:00.729170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:00.756614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:00.766272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5468baeb-c432-4d86-845b-b3e1c861ef89 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095940 Sep 13 20:03:00.767026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1114/2217] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:00.897523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:00.906022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d7a417ab-1bb7-4cd0-a327-8c7305aea096 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193269 Sep 13 20:03:00.907135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1104/2218] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:01.790845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:01.791532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:01.801095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.801982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.802681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:01.803842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.804610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.805363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:01.881496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:01.892044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bd199431-760e-4418-9119-ee521a3988db tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105186 Sep 13 20:03:01.892630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1115/2219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:01.931315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:01.932125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:01.939514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.940186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.940732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:01.941715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:01.942234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:01.942738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:02.105714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:02.116779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-efed0331-86cb-4ed8-8c50-a99d9c42d356 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.189375 Sep 13 20:03:02.117795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1105/2220] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:02.916469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:02.917354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:02.924186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:02.924712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:02.925138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:02.925854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:02.926308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:02.926720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:02.931136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:03.008176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:03.017724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-25bc79a2-680b-48cc-a38f-5b85153ac28b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105760 Sep 13 20:03:03.018305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1116/2221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:03.142964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:03.143612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:03.150424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:03.151017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:03.151364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:03.152062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:03.152524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:03.152949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:03.314238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:03.327290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cb5789f0-3918-4c11-b99f-36ce0920fafb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.188924 Sep 13 20:03:03.328504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1106/2222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:04.044559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:04.045520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:04.053291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.053820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.054253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.054962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.055433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.055856 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.130084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:04.138706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f1126043-9b07-4320-94d7-aa7809a65c73 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099820 Sep 13 20:03:04.139290 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1117/2223] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:04.352373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:04.353070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:04.365091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.366229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.366998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.368217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:04.369019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:04.369869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:04.538229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:04.547766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c57947fe-6b0d-4f98-93bf-c79a1821639f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.199477 Sep 13 20:03:04.548359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1107/2224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:05.163440 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:05.164361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:05.170926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:05.171332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:05.171857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.172552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:05.173005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:05.173441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.248931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:05.259612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cd254f49-ff4d-4950-b883-d5b7f2a4a798 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100074 Sep 13 20:03:05.260245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1118/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:05.572108 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:05.573006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:05.575273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=50 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:05.582196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:05.582685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:05.583119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.583810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:05.584258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:05.584680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:05.736404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:05.744834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a5d18ced-e036-49de-a658-cfe4e77248b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176550 Sep 13 20:03:05.745401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1108/2226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:06.283282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:06.283909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:06.286219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=54 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:06.291405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.291882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.292310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.292992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.293430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.293886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.361335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:06.369133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-695a0654-b7e9-4659-ac77-b37d84082890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090468 Sep 13 20:03:06.369726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1119/2227] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:06.772569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:06.773201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:06.780126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.780617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.781640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.782344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:06.782808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:06.783238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:06.926177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:06.934502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9aacfb81-192c-4eb0-bbea-26e2230ff88c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165865 Sep 13 20:03:06.935162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1109/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:07.404211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:07.406288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:07.420333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.420816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.421245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:07.422546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.423021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.423439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:07.486142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:07.495566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ccb5ef10-0555-48ff-b92e-b497d2387176 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098495 Sep 13 20:03:07.496129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1120/2229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:07.965263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:07.965878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:07.973314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.973831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.974267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:07.974949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:07.975412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:07.975829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:08.115605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:08.125194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b8516fd3-cee0-47af-a7a6-435f89e22d07 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.163870 Sep 13 20:03:08.125789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1110/2230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:08.518960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:08.519899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:08.526382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:08.526862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:08.527309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:08.528007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:08.528453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:08.529148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:08.602033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:08.611232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6444f48f-902b-4745-bf0a-83e1f3e57f9c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096127 Sep 13 20:03:08.611810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1121/2231] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:09.149184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:09.149906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:09.157225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.157754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.158194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.158888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.159339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.159765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.307974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:09.320184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-189674df-8711-46a3-8cac-cfbef28f80a2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.174862 Sep 13 20:03:09.320966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1111/2232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:09.647135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:09.647843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:09.655199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.655707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.656139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.656829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:09.657274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:09.657756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:09.734668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:09.743240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d2f2d1a0-d29d-4c89-bc23-82728ad22706 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100691 Sep 13 20:03:09.743826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1122/2233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:10.346471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:10.347034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:10.353703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:10.354750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:10.354750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:10.357820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:10.357820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:10.357820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:10.500368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:10.513974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8ab7e118-8b90-43f7-b17e-83728d84874e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.172137 Sep 13 20:03:10.514667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1112/2234] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:10.768556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:10.769499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:10.776002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:10.776492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:10.776942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:10.777652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:10.778109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:10.778581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:10.852650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:10.861937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0bdaf43b-5ea0-4362-a163-caeb49dd41e3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097515 Sep 13 20:03:10.862531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1123/2235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:11.540112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:11.540720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:11.555781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.556632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.557417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.558633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.559431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.560172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.825275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:11.837418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bec8d98d-730c-4ab2-af26-9fcaee45c411 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.302179 Sep 13 20:03:11.838505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1113/2236] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:11.887801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:11.888737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:11.896479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.896966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.897400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.898152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:11.898591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:11.899017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:11.975714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:11.985804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bb7b1e78-fdf0-45c2-a90e-9053dfb3b5a7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.103653 Sep 13 20:03:11.986455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1124/2237] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:12.863433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:12.864041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:12.870575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:12.871050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:12.871485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:12.872215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:12.872663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:12.873085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.007857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:13.008920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:13.011638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:13.017666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:13.018323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:13.018923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.019747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:13.020386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:13.023104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:13.026367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cc75c207-c7e8-4a93-aa3a-1e6f398922b0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167398 Sep 13 20:03:13.026944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1114/2238] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:13.105352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:13.119984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c8795e9a-dd8a-46f7-b4eb-f020c0cd1a05 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116172 Sep 13 20:03:13.120934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1125/2239] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:14.050350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:14.051188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:14.057524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.058036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.058473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.059153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.059698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.060121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.149532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:14.150236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:14.158005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.158490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.158931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.159634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:14.160078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:14.160500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:14.254182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:14.260588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:14.262470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e527f194-b5a6-4f05-9169-ad1e7df8afb6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117578 Sep 13 20:03:14.263052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1126/2240] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:14.263247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:14.276128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-70e94b9f-04ad-4a5e-919e-c3e3f3fad408 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.229372 Sep 13 20:03:14.277192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1115/2241] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:15.293696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:15.294288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:15.302608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:15.303022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:15.303755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:15.303755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:15.303994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:15.304641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:15.305446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:15.305994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:15.316300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:15.317013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:15.318017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:15.318844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:15.319482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:15.320029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:15.393959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:15.402209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-60de4dca-7ae7-4de5-a281-acc4974bb343 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112429 Sep 13 20:03:15.402791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1127/2242] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:15.492452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:15.501997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-075546bf-a901-402e-9d17-0b47c10a1cfa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.204137 Sep 13 20:03:15.502605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1116/2243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:16.429665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:16.430541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:16.437001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:16.437486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:16.437948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.438642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:16.439088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:16.439508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.507482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:16.517599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-67f411ee-1380-4fb7-918d-6b5db5298cf8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092356 Sep 13 20:03:16.518370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1128/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:16.528277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:16.529412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:16.537501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:16.538300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:16.538770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.539471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:16.539936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:16.540363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:16.702934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:16.711406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9814efa0-ddb6-4ca8-8384-3784fb4ba1cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.188361 Sep 13 20:03:16.711973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1117/2245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:17.542694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:17.543387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:17.551930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.552406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.552836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.553522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.553993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.554409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.624516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.635295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-35ecd48d-abbe-484b-9bd7-b671a0db258e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096299 Sep 13 20:03:17.635796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1129/2246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:17.735864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:17.736484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:17.743175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.743660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.744099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.744929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.745403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.745879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.900998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.916274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6b8ca5b7-5a2c-420a-8499-21540a07827a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.184623 Sep 13 20:03:17.916853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1118/2247] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:18.657988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:18.658749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:18.665121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.665601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.666194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.666752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.667219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.667636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.735424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:18.743605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4f440ae8-a76c-40ea-a215-2a1cc3ddf1d5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090015 Sep 13 20:03:18.744266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1130/2248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:18.940122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:18.940681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:18.947283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.947769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.948199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.948879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.949342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.949768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.100351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:19.109547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9af3c6ee-53a4-4066-a264-cf3ad97015db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.173422 Sep 13 20:03:19.110155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1119/2249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:19.768547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:19.769595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:19.776408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.776885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.777310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.778041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.778726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.779145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.845552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:19.854554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-22c4a73a-eb39-4d70-a7c1-31fa4266afd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090409 Sep 13 20:03:19.855151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1131/2250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:20.134260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:20.135086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:20.141793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.142265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.142692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.143378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.143846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.144262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.288661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:20.297577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-32852e2f-d219-40e9-8923-086a2d75affd tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.168265 Sep 13 20:03:20.298151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1120/2251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:20.890740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:20.891477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:20.900669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.901365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.902394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.903242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:20.904049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:20.904509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.984862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:20.987298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:20.995289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e18bc210-f0ae-4b1e-83d5-e7fcdc9be565 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108460 Sep 13 20:03:20.995881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1132/2252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:21.326704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:21.330851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:21.336926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:21.337806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:21.338505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:21.339258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:21.342373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:21.342373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:21.492368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:21.501463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ae8ae053-8039-4ea3-adbe-c867433697fc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.181653 Sep 13 20:03:21.502082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1121/2253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:22.022456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:22.023256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:22.034879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.035733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.036525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.037999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.038793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.039603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.122159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.130459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0cd70c0-a590-4c1b-8264-2770537f5dce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.114655 Sep 13 20:03:22.131045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1133/2254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:22.525936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:22.526478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:22.533703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.534195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.534824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.535554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.536173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.536594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.691596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.700767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-10db9c0d-97f9-4523-888b-1d19fa200799 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.178985 Sep 13 20:03:22.701353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1122/2255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:23.156030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:23.157032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:23.164921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.165451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.165927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.166698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.167187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.167603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.233766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:23.247080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-484c6693-c4b3-4667-87ae-e25a41cb2c2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095267 Sep 13 20:03:23.247816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1134/2256] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:23.725281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:23.725887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:23.732654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.733688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.734173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.735025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.735616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.736241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.895318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:23.904059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b2a146fe-9450-4266-9d84-ede289f8a150 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.182311 Sep 13 20:03:23.904638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1123/2257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:24.277340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:24.277980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:24.285646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.286139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.286568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.287254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.287695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.288104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.362669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:24.370888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-126078f5-41e4-4918-89f3-7059e0636945 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097396 Sep 13 20:03:24.371478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1135/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:24.929007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:24.932138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:24.939755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.940243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.940680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:24.941370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:24.941863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:24.942299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.110575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:25.120688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e661ef0a-1d2a-4258-be95-2b038a1707a0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.196805 Sep 13 20:03:25.121279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1124/2259] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:25.394573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:25.395352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:25.404439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.405297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.406011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.407162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:25.407962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:25.408989 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:25.492300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:25.503386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6a399294-c2b1-4879-a47c-995672d60569 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112779 Sep 13 20:03:25.513185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1136/2260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:26.146711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:26.147325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:26.155652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.156277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.156828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.157965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.158525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.159062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.330227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.339324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0dff4312-6bf1-49a2-babf-f7c35a518365 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.197227 Sep 13 20:03:26.339883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1125/2261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:26.529206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:26.529985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:26.540515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.541377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.542192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.543412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:26.544218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:26.544991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:26.622131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:26.630907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-532f730a-2be8-4032-870f-dbba02c623a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105801 Sep 13 20:03:26.631494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1137/2262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:27.367252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:27.368304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:27.379437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:27.380239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:27.380955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:27.382129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:27.382867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:27.383573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:27.573487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:27.587762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4d5a1a34-85b5-4013-b338-f1fc0a981e06 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.226617 Sep 13 20:03:27.588735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1126/2263] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:27.654607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:27.656039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:27.662753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:27.663415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:27.664126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:27.664865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:27.665354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:27.665954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:27.734925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:27.743086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2f64e7f1-1edc-4bde-84fe-c5155d1dbd38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092696 Sep 13 20:03:27.743660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1138/2264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:28.625845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:28.626454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:28.633287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:28.633889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:28.634281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:28.634964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:28.635404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:28.635820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:28.768522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:28.769554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:28.776043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:28.776534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:28.776974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:28.777705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:28.778657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:28.780385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:28.803859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:28.812744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4c2e8137-d049-4613-9d59-2e1aaeb8e463 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.190843 Sep 13 20:03:28.813711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1127/2265] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:28.878245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:28.887692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-87f4d34c-21db-4066-836e-34956ae1031a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.125319 Sep 13 20:03:28.888319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1139/2266] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:29.842281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:29.842884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:29.849526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:29.850037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:29.850466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:29.851141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:29.851580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:29.852021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:29.917477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:29.918602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:29.927153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:29.927646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:29.928082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:29.928770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:29.929219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:29.929660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:30.010363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:30.020452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bd20c71b-c885-4a62-befd-47a7accad734 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.110029 Sep 13 20:03:30.021382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1140/2267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:30.050205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:30.058576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e9b8eb9b-54c2-49a2-b0ca-0541981d53c8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.221812 Sep 13 20:03:30.059158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1128/2268] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:31.054141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:31.054923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:31.061985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:31.062469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:31.062902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:31.063620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:31.064070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:31.064494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:31.086432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:31.087332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:31.099975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:31.100549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:31.100988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:31.101714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:31.102162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:31.102675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:31.145015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:31.153054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f78f3134-2b0e-4a7f-948a-7dd230b6dd36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102741 Sep 13 20:03:31.154216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1141/2269] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:31.273786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:31.282727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4ca9e43f-c3c6-42eb-b5b9-bb58ef91fb3a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.202600 Sep 13 20:03:31.283363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1129/2270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:32.178169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:32.178758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:32.185220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:32.186366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:32.186800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:32.187492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:32.187945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:32.188360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:32.257151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:32.265334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-64aeae27-a7ae-40f3-b937-30689f811453 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091100 Sep 13 20:03:32.265966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1142/2271] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:32.306524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:32.307127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:32.315098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:32.315586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:32.316023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:32.316727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:32.317178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:32.317631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:32.470375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:32.479622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2205a182-8f3f-41ad-9f1b-bffea9c99a1f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176991 Sep 13 20:03:32.480214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1130/2272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:33.289285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:33.289862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:33.297165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:33.297674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:33.298113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:33.298805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:33.299250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:33.299669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:33.378984 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:33.387336 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6bc475f5-5df7-47c0-aade-6bfbc77a5f9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.102689 Sep 13 20:03:33.387929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1143/2273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:33.506464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:33.507267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:33.515096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:33.515623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:33.516131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:33.516844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:33.517284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:33.517781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:33.668541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:33.677027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-02afef3c-22f1-45c9-bc83-c719256c4ab2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176304 Sep 13 20:03:33.677631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1131/2274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:34.412982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:34.413597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:34.422665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:34.423157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:34.423592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:34.424282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:34.424737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:34.425160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:34.508929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:34.517079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1a046961-ad0b-49e2-8184-ac084b8d7065 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108078 Sep 13 20:03:34.517693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1144/2275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:34.704166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:34.704941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:34.713748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:34.714265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:34.714712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:34.715509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:34.715992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:34.716416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:34.733063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:34.877497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:34.885468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-069a64ce-b557-4e7d-8c57-2cb68fad069a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.187981 Sep 13 20:03:34.886097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1132/2276] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:35.543154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:35.543761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:35.550835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:35.551324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:35.551765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:35.552478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:35.552929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:35.553366 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:35.626510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:35.634874 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1001b7ff-a1a6-451a-a196-0f676254ba7a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095474 Sep 13 20:03:35.635457 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1145/2277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:35.912469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:35.913314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:35.917050 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=50 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:35.927011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:35.927786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:35.928527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:35.929855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:35.930344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:35.930778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:36.096060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:36.104260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0ca4c2d1-ac48-4b69-bfa7-bf8d26d4d509 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.197891 Sep 13 20:03:36.104842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1133/2278] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:36.659693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:36.660484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:36.663105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=54 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:36.668798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:36.669300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:36.669782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:36.670472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:36.671012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:36.671671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:36.746260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:36.754441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5b15001b-e913-4bc6-8a9f-33a094cbcb52 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098835 Sep 13 20:03:36.755034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1146/2279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:37.129755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:37.130423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:37.137750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:37.138315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:37.139302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:37.140014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:37.140470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:37.140900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:37.311369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:37.320208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-43d1e473-9843-4718-9aa6-aeca09b80ea7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.194390 Sep 13 20:03:37.320790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1134/2280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:37.782040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:37.783026 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:37.793587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:37.794448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:37.795740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:37.796870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:37.804316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:37.804316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:37.865500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:37.873808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e74f4b5b-93a9-42a4-913f-757da42044cb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098606 Sep 13 20:03:37.874452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1147/2281] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:38.348101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:38.348758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:38.354932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:38.355415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:38.355849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:38.356528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:38.356968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:38.357408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:38.500486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:38.512292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6d27242d-cc84-417c-a17f-f88829b20671 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.168929 Sep 13 20:03:38.512885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1135/2282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:38.896705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:38.897342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:38.904477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:38.904950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:38.905374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:38.906105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:38.906551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:38.906967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:38.970068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:38.978049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4e5f232f-fa2d-4221-a615-6e5bcdddf7bd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085346 Sep 13 20:03:38.978657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1148/2283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:39.539070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:39.539782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:39.546895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:39.547380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:39.547820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:39.548532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:39.548975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:39.549398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:39.710060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:39.719055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f200ea10-b342-4cff-9683-0b7bc44531cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185472 Sep 13 20:03:39.719649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1136/2284] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:40.008391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:40.009196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:40.020857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:40.021417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:40.022286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:40.023424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:40.024126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:40.024782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:40.042612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:40.103009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:40.113757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ef1131a8-aa60-45e8-be27-c8a47221cda9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112991 Sep 13 20:03:40.114361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1149/2285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:40.742801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:40.743495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:40.750247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:40.750595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:40.751309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:40.751727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:40.752181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:40.752612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:40.898903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:40.909191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b9cd8b08-8531-4ae7-bb5b-898c3f1d80cc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170238 Sep 13 20:03:40.909803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1137/2286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:41.137855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:41.139116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:41.145939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:41.146429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:41.146858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:41.147546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:41.147985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:41.148399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:41.214825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:41.226162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-70c54e39-8e4d-4eb3-be75-85bf69dcafac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091891 Sep 13 20:03:41.226848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1150/2287] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:41.933424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:41.934075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:41.941236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:41.941753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:41.942190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:41.942872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:41.943317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:41.943739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:42.089371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:42.098327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34298ab7-42a9-4a35-bd68-e5c834c4ebdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.168682 Sep 13 20:03:42.098915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1138/2288] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:42.250528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:42.251110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:42.257567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:42.258101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:42.258541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:42.259227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:42.259679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:42.260104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:42.329936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:42.339370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-994d3ab5-735f-4f7f-806d-abc723e26c07 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093193 Sep 13 20:03:42.339963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1151/2289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:43.138701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:43.140131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:43.147809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:43.148287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:43.148723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:43.149404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:43.149874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:43.150287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:43.302509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:43.310775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a8fcc1f4-5a5d-4402-b623-cb9250466f73 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176229 Sep 13 20:03:43.311329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1139/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:43.368410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:43.369045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:43.376138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:43.376639 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:43.377080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:43.377822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:43.378354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:43.378775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:43.451921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:43.461693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-512c43a7-a816-4c15-842f-058386cd13b3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097141 Sep 13 20:03:43.462305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1152/2291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:44.334922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:44.335477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:44.342542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:44.343031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:44.343476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:44.344183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:44.344712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:44.345058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:44.481018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:44.486779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:44.488307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:44.490273 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bc8a6d17-217d-4de8-973f-36553ca53d71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159217 Sep 13 20:03:44.490838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1140/2292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:44.493815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:44.494369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:44.494869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:44.495754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:44.496199 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:44.496612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:44.562496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:44.571437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e3d5f4b2-b992-4a2d-87ad-8014289088df tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089817 Sep 13 20:03:44.572015 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1153/2293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:45.513041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:45.513664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:45.520175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:45.520672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:45.521177 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:45.521917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:45.522372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:45.522810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:45.596193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:45.596797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:45.603683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:45.604260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:45.604701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:45.605752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:45.605944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:45.607278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:45.689226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:45.694041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:45.702802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3e357eec-dc4b-457a-9114-e1257c0a0d5d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193475 Sep 13 20:03:45.703445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1141/2294] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:45.704923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6404b6b2-c90c-4d3f-a6d3-5e5a5548c249 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112479 Sep 13 20:03:45.705484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1154/2295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:46.728944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:46.729540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:46.729979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:46.730166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:46.735944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:46.736425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:46.736652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:46.736855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:46.737133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:46.737579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:46.737802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:46.738306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:46.738489 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:46.738755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:46.738912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:46.739182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:46.815234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:46.827368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-110bd6d3-ec6e-4115-8dd7-576f1deb7a40 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101447 Sep 13 20:03:46.838135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1142/2296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:46.916972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:46.924782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4dfd9ba2-90cd-40e6-aaf2-a6d37957f2a4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.199167 Sep 13 20:03:46.925357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1155/2297] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:47.851370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:47.852023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:47.859476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:47.859959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:47.860392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:47.861082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:47.861531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:47.861977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:47.927590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:47.936284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-286b5e76-6ce9-4dcc-90e6-981b394cc7cd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088508 Sep 13 20:03:47.936862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1143/2298] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:47.948056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:47.948694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:47.956331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:47.956811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:47.957563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:47.958295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:47.958749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:47.959172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:48.109927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:48.121776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f41c4ea0-4f1c-4f03-9a1a-0705c06a146d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.177442 Sep 13 20:03:48.122364 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1156/2299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:48.959450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:48.960085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:48.966571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:48.967141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:48.967653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:48.968358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:48.968802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:48.969213 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:49.041748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:49.049881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aa960392-ccd4-460c-857f-5f4faaed7474 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094288 Sep 13 20:03:49.050458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1144/2300] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:49.145204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:49.145818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:49.152514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:49.153313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:49.153849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:49.154613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:49.155118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:49.155628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:49.310390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:49.320265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dc5dccba-a458-45ed-a187-8b990d3b38a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.178902 Sep 13 20:03:49.320933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1157/2301] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:50.075249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:50.076200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:50.087736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:50.088631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:50.089377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:50.090408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:50.090865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:50.091569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:50.154175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:50.162063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-42230140-d568-4515-8b31-7855725ef9bf tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093307 Sep 13 20:03:50.162627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1145/2302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:50.345448 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:50.346028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:50.352515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:50.353030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:50.353467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:50.354182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:50.354638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:50.355062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:50.496236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:50.504191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-802b6d98-6772-4f37-828e-d1efeef4285b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.163135 Sep 13 20:03:50.504791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1158/2303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:51.186257 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:51.186822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:51.193294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:51.193807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:51.194247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:51.194941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:51.195392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:51.195908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:51.259586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:51.268093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3ee38b07-c342-45ca-970f-e7ef8988de8d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086586 Sep 13 20:03:51.268670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1146/2304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:51.527965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:51.528528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:51.535257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:51.535744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:51.536184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:51.536880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:51.537325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:51.537796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:51.679579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:51.688151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-76476a8d-39a1-4573-9d5b-586e29955497 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164411 Sep 13 20:03:51.688738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1159/2305] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:52.292501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:52.293279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:52.300212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:52.301029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:52.301187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:52.301874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:52.303416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:52.303416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:52.395228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:52.405619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-66f27f9c-e0c2-4c47-b9aa-fb7ccafc12d3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.117496 Sep 13 20:03:52.406225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1147/2306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:52.711454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:52.712063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:52.718751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:52.719237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:52.719690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:52.720367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:52.720814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:52.721277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:52.869320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:52.881264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-114e275c-efed-4a09-87e3-21b2fa6f6c92 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.173577 Sep 13 20:03:52.881905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1160/2307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:53.428605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:53.429265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:53.436302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:53.436784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:53.437210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:53.437920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:53.438365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:53.438781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:53.509641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:53.518209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9388626e-02c1-4639-9dc4-03c0aeda95b2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093523 Sep 13 20:03:53.518795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1148/2308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:53.905202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:53.905893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:53.912609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:53.913158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:53.913590 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:53.914332 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:53.914776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:53.915197 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:54.340251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:54.350504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29653fb0-f7b4-43d0-8164-6b29cb163e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.449642 Sep 13 20:03:54.351168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1161/2309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:54.543813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:54.544511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:54.551550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:54.552035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:54.552741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:54.553438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:54.553997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:54.554419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:54.557217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:54.624792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:54.632669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a22da99-8120-4b6f-ad3c-12ab7f099f92 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094540 Sep 13 20:03:54.633237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1149/2310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:55.375404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:55.376019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:55.392902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:55.393381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:55.393840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:55.394528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:55.394974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:55.395393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:55.542626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:55.551446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3cf851ac-3e0a-4632-b42a-59e5dfa17d6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.180316 Sep 13 20:03:55.552038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1162/2311] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:55.658652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:55.659249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:55.666883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:55.667379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:55.667810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:55.668526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:55.669548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:55.670002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:55.737505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:55.745832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-25800c09-f7ad-4f96-8d8b-4aa72d43811c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093642 Sep 13 20:03:55.746944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1150/2312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:56.577907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:56.578553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:56.585267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:56.585804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:56.586237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:56.586931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:56.587378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:56.587790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:56.725380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:56.735198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0a0cf19e-bd12-48c8-b3cd-f0a5fe49f01b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.161654 Sep 13 20:03:56.735858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1163/2313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:56.770420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:56.771053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:56.777929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:56.778365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:56.778807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:56.779508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:56.779958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:56.780383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:56.854060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:56.865695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-02ba05f9-2d55-4ef6-a827-6754739d047b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098894 Sep 13 20:03:56.866737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1151/2314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:57.763470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:57.764089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:57.770790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:57.771274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:57.771711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:57.772400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:57.772847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:57.773259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:57.891085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:57.891801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:57.898951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:57.899548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:57.899980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:57.900889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:57.901343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:57.901804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:57.909671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:57.917421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-05bc83b6-7029-4ade-bfac-86a3f79214ef tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158432 Sep 13 20:03:57.918033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1164/2315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:58.152376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:58.161031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3b3a7b73-d3cf-4c14-ba57-211f893a455a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.274430 Sep 13 20:03:58.161586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1152/2316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:58.941207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:58.941833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:58.953020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:58.953504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:58.953962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:58.954680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:58.955085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:58.955499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:59.101528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:59.110507 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d46ab7c7-33b9-4bf1-9ec2-764d7c5fc988 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.173222 Sep 13 20:03:59.111068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1165/2317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:59.184946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:59.185705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:59.192662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:59.193062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:59.193491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:59.194199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:59.194638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:59.195053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:59.261764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:59.270866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-67032346-f359-4603-8af5-be809a0e0b36 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090511 Sep 13 20:03:59.271433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1153/2318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:00.134480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:00.135087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:00.142371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:00.142860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:00.143293 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:00.143998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:00.144475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:00.144861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:00.147591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:00.295021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:00.295668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:00.302664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:00.303158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:00.303597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:00.304302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:00.304752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:00.305178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:00.337685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:00.345525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1014be30-13f3-4453-9398-7aeecb180ec1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.214906 Sep 13 20:04:00.353831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1166/2319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:00.367723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:00.378350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0d41bf08-2d6f-47f3-84c4-53ea5674225d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087825 Sep 13 20:04:00.378977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1154/2320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:01.376504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:01.377157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:01.383814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:01.384300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:01.384734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:01.385441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:01.385928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:01.386350 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:01.404026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:01.404919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:01.413728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:01.414555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:01.415235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:01.416181 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:01.416850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:01.417432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:01.513246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:01.521470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-af61bcc0-27b9-4aa7-bb0d-66946ee0b650 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.123405 Sep 13 20:04:01.522167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1155/2321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:01.582927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:01.596418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1b36b15e-7de1-43cc-a398-ef60d99074ca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.229709 Sep 13 20:04:01.597005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1167/2322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:02.547781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:02.548395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:02.554926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:02.555336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:02.555766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:02.556452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:02.556893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:02.557310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:02.620878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:02.621080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:02.621557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:02.627996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:02.628524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:02.628875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1cc83955-2332-48f6-82b1-f07b233b1055 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085583 Sep 13 20:04:02.628997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:02.629461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1156/2323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:02.629579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:02.630063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:02.630484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:02.767238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:02.775055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-673bb199-2e34-411c-bee0-a28de87bb008 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158114 Sep 13 20:04:02.775622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1168/2324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:03.651528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:03.652147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:03.658974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:03.659472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:03.659904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:03.660630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:03.661082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:03.661594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:03.731656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:03.739744 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-03e0da2e-c75d-4a05-89b0-aa34c198da4e tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092112 Sep 13 20:04:03.740322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1157/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:03.800005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:03.800616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:03.807370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:03.807873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:03.808312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:03.809061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:03.809517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:03.809969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:03.946244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:03.955762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-34e930b2-81ac-43d8-8eaa-583e5fd152d5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159715 Sep 13 20:04:03.956337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1169/2326] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:04.763896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:04.764498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:04.770966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:04.771484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:04.771932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:04.772646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:04.773104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:04.773531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:04.840374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:04.848156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d29ed46d-287b-43e8-8f1c-2817b7776f72 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088697 Sep 13 20:04:04.848718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1158/2327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:04.979516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:04.980128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:04.987247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:04.987764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:04.988173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:04.988877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:04.989329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:04.989784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:05.128464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:05.136243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fdc64870-d64d-4128-a3a9-aa3ba7d98e15 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.160553 Sep 13 20:04:05.136810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1170/2328] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:05.872240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:05.873307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:05.881880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:05.882374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:05.882816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:05.883517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:05.884012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:05.884394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:05.952211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:05.960241 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d8009b9d-7c67-409f-9cee-281704d72b0f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092635 Sep 13 20:04:05.960827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1159/2329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:06.159979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:06.160546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:06.167603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.168181 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.169137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.169893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.170383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.170815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.313005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:06.321175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-600ba47d-4942-4ee7-9dff-06c84af67cb0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165093 Sep 13 20:04:06.321779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1171/2330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:06.982867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:06.983473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:06.985780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=54 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:06.991209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.991688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.992200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:06.992887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:06.993334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:06.993789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:07.057719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:07.066026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7e5a1c44-9050-445d-9ccd-4603b6d7e099 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087008 Sep 13 20:04:07.066633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1160/2331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:07.344549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:07.345108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:07.347401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=52 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:07.352767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:07.353253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:07.353714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:07.354416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:07.354971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:07.356258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:07.491552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:07.500162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-32546a3e-8cd0-45bf-811f-c2ba68744d2a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159605 Sep 13 20:04:07.500743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1172/2332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:08.088491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:08.089243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:08.096129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:08.096622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:08.097063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:08.097795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:08.098249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:08.098677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:08.167129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:08.175491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-840a9cd4-46de-43a9-818a-e67e6d9fa61b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090896 Sep 13 20:04:08.176069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1161/2333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:08.523884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:08.524698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:08.531544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:08.532021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:08.532447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:08.533406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:08.533883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:08.534304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:08.672842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:08.682061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a27b142b-5d0a-4eca-86bc-180120325e58 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162031 Sep 13 20:04:08.682651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1173/2334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:09.198941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:09.200198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:09.206685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:09.207165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:09.207596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:09.208277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:09.208724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:09.209142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:09.271947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:09.280792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-77de7a30-5187-4395-b1cc-d8981d4517a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085137 Sep 13 20:04:09.280792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1162/2335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:09.705481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:09.706259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:09.713173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:09.713806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:09.714246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:09.714982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:09.715423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:09.715842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:09.853428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:09.866269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d347f9a0-a85e-4c14-b92e-b1ecaa0da081 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164744 Sep 13 20:04:09.866854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1174/2336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:10.302298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:10.302862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:10.309254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:10.309774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:10.310214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:10.310894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:10.311342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:10.311770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:10.373432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:10.381595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c42c4082-80ce-4bd1-8b79-647c56e85819 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083202 Sep 13 20:04:10.382178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1163/2337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:10.890434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:10.891035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:10.897583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:10.898083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:10.898511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:10.899188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:10.899630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:10.900046 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.035411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:11.044012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b6eb5065-c9e0-42f6-bc74-6e487fb4d6d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158037 Sep 13 20:04:11.044581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1175/2338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:11.405262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:11.405937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:11.413318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.413912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.414347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.415038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.415515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.415952 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.484666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:11.492580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b8c2881d-3ef9-4bd4-a722-274e182a60b1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092037 Sep 13 20:04:11.493142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1164/2339] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:12.067769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:12.068356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:12.075465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.075945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.076377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.077057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.077503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.077946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.210860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:12.218992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d39687bf-f547-4034-821d-172b7868413d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155061 Sep 13 20:04:12.219555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1176/2340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:12.524020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:12.524619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:12.531455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.531939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.532379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.533063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.533516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.533973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.606418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:12.608653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:12.615892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3d68c219-8f57-4e0e-bfb5-6ebc94400cd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095715 Sep 13 20:04:12.616483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1165/2341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:13.242127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:13.242733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:13.249517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.250033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.250549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.251396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.251840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.252260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.485065 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:13.490823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a2df9a6a-777b-4ac9-82b2-484221655b39 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.252656 Sep 13 20:04:13.492238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1177/2342] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:13.640156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:13.640765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:13.648063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.648450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.648892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.649582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.650053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.650474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.739498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:13.748250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-26cabf1a-1bb2-4a3b-a4af-03f4d90f1201 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.112537 Sep 13 20:04:13.754989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1166/2343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:14.517073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:14.517724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:14.524177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.524656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.525091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.525811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.526260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.526680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.659877 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:14.669043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7632452d-5da5-4911-a27d-f5a8b8162104 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156210 Sep 13 20:04:14.669867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1178/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:14.771901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:14.772570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:14.787860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.788352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.788803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.789514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.790002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.790432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.854638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:14.862505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c804fe1c-eb61-416a-9c5b-2b4a0d12e807 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094634 Sep 13 20:04:14.863082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1167/2345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:15.691944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:15.692549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:15.699453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.699934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.700367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.701055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.701503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.701951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.845518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:15.857959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6b6781be-cc6b-4fa3-8118-e654b8deed69 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169817 Sep 13 20:04:15.858568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1179/2346] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:15 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:15.884391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:15.885394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:15.891845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.892342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.892792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.893496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.893972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.894397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.962404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:15.970831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1edab03e-476b-4f0c-9820-0998c1431b74 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090341 Sep 13 20:04:15.971406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1168/2347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:15 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:16.881091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:16.881738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:16.888447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:16.888926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:16.890071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:16.890789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:16.891253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:16.891682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:16.995422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:16.996276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:17.003009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:17.003522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:17.004121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:17.004826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:17.005270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:17.005737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:17.036752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:17.049902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ce46c206-32c5-4c16-ba72-a1da9abcf390 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.171638 Sep 13 20:04:17.050123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1180/2348] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:17.072723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:17.082392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a1cb5f9d-de69-491b-8c18-2ae75e49da85 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091085 Sep 13 20:04:17.082981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1169/2349] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:18.073587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:18.074218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:18.080660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.081140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.081571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.082271 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.082717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.083139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.106758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:18.107370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:18.113305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.113823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.114264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.114959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.115409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.115839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.197854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:18.205586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c113d702-eea0-4876-b673-146cb61c7ee0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.103911 Sep 13 20:04:18.206558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1170/2350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:18.236401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:18.244198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1b4d5b68-c034-42fc-a6f6-33083a9d665f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.174495 Sep 13 20:04:18.244759 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1181/2351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:19.228498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:19.229100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:19.236259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:19.236749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:19.237179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.237904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:19.238354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:19.238784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.267023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:19.268224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:19.275260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:19.275666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:19.276093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.276831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:19.277543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:19.278014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.302790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:19.311504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-152f72b9-0e94-474e-bbc2-9dbbc09d4b5c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086985 Sep 13 20:04:19.312083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1171/2352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:19.410627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:19.412815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:19.420554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-241a119a-9c5c-489f-aa58-a6831d4352b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157287 Sep 13 20:04:19.421134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1182/2353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:20.333961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:20.334539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:20.341351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.341862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.342286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.342954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.343395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.343811 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.408879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:20.416797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8122eafc-7d2a-47f7-b6c0-f6b6bd1c3328 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086765 Sep 13 20:04:20.417972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1172/2354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:20.444068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:20.444683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:20.451275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.451754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.452187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.452869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.453318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.453771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.581334 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:20.589663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-38fbda02-c622-4dcf-942a-ed1a21dae4cf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.148844 Sep 13 20:04:20.590191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1183/2355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:21.439374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:21.439977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:21.446938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.447411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.447855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.449052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.449501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.449954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.516071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:21.523933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c43de9cf-9089-479f-8b41-9ae812209c9b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088347 Sep 13 20:04:21.524499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1173/2356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:21.613773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:21.614380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:21.620771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.621247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.621705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.622384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.622833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.623247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.754211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:21.762810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2c2e353a-8e6b-447f-bd98-af77ecfac649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.153113 Sep 13 20:04:21.763374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1184/2357] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:21 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:22.547501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:22.548064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:22.555933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.556411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.556864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.557543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.558769 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.559192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.622704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:22.630495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e06b62fa-1c02-410b-a846-60a8e65261fc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086997 Sep 13 20:04:22.631066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1174/2358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:22.786283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:22.786922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:22.794165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.794643 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.795075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.795770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.796218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.796638 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.927438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:22.935156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6138cc2e-829e-4367-a813-463e050f1fae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.152728 Sep 13 20:04:22.935720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1185/2359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:23.653244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:23.653884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:23.660242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:23.660756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:23.661188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:23.661892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:23.662338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:23.662759 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:23.738507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:23.747898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8d4539d7-3839-4815-b61d-c603e78b4c04 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098700 Sep 13 20:04:23.748584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1175/2360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:23.958717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:23.959294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:23.965562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:23.966064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:23.966493 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:23.967167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:23.967609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:23.968022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:24.107613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:24.115368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-984a2adf-f6bf-422e-98d5-5b6bed541d66 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.160522 Sep 13 20:04:24.115934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1186/2361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:24.770531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:24.771160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:24.778062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:24.778554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:24.778992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:24.779682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:24.780154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:24.780556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:24.845062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:24.852770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-49dd7275-1838-4504-baf6-460d58953171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086146 Sep 13 20:04:24.853328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1176/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:25.139826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:25.140424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:25.146934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:25.147414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:25.148016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:25.148703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:25.149142 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:25.149555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:25.285279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:25.292987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bac643ae-c067-415f-a2fa-0b70cd1dbf1b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157067 Sep 13 20:04:25.293551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1187/2363] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:25.876682 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:25.877283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:25.883692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:25.884164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:25.884593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:25.885263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:25.886409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:25.886831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:25.946560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:25.954962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dbd7da65-629e-4fdb-ae99-736a3d244fd1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082104 Sep 13 20:04:25.955527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1177/2364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:25 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:26.316580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:26.317133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:26.319155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:04:26.319299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:04:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:04:26.326177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:26.326652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:26.327084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:26.327774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:26.328215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:26.328630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:26.464300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:26.471960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1931a7d2-270d-4a4d-8bdf-52788ee09098 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159666 Sep 13 20:04:26.472521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1188/2365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:26.977434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:26.978057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:26.984447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:26.984918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:26.985347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:26.986057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:26.986508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:26.986920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:27.049936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:27.057622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-98913547-ace0-4197-b318-0ec078781ff3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084074 Sep 13 20:04:27.058184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1178/2366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:27.497709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:27.498328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:27.505279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:27.505792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:27.506228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:27.506916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:27.507363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:27.507788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:27.639711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:27.647377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-40470363-dd4a-4a0d-8ffe-d8dcb6bb290d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.154152 Sep 13 20:04:27.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1189/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:28.080550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:28.081172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:28.088641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:28.089136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:28.089572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:28.093676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:28.094161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:28.094600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:28.158390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:28.166559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5abb83c4-0a1d-4d48-8c7e-aa1a8f9bd3f5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089944 Sep 13 20:04:28.167168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1179/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:28.675162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:28.675760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:28.682160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:28.683160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:28.683579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:28.684245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:28.684684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:28.685100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:28.819348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:28.828158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-60c2d5b3-fa96-4ff7-8800-8cacf44590b7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156803 Sep 13 20:04:28.828725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1190/2369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:29.191126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:29.191772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:29.199080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:29.199562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:29.199994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:29.200672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:29.201119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:29.201568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:29.262890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:29.270953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c34a4d7e-db71-43b3-818f-14f5ab8a96ac tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083652 Sep 13 20:04:29.271450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1180/2370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:29.851075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:29.851679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:29.858556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:29.859025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:29.859449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:29.860119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:29.860557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:29.860968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:29.994137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:30.002518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-33683b9b-869c-477a-838e-4171aee9fe7e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155290 Sep 13 20:04:30.003083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1191/2371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:30.296233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:30.296790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:30.303608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:30.304093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:30.304528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:30.305331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:30.305817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:30.306246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:30.367297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:30.375426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-136c5498-4501-4d89-aad9-e238d30a66a4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083608 Sep 13 20:04:30.376006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1181/2372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:31.027023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:31.027625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:31.034093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:31.034566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:31.034994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:31.035662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:31.036132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:31.036549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:31.167077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:31.174788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8da33285-374e-4dba-bf68-a9beb1f0e46f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.151861 Sep 13 20:04:31.175342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1192/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:31.398509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:31.399095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:31.405800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:31.406276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:31.406729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:31.407415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:31.407859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:31.408277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:31.423554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:31.477088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:31.486217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-be1b2ccd-36c4-4efd-b1a2-25360e6f377d tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.091530 Sep 13 20:04:31.486779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1182/2374] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:32.198843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:32.199576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:32.205899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:32.206374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:32.206791 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:32.207455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:32.207896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:32.208314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:32.346896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:32.355235 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4e315bde-08fb-4136-9dfc-5f849045969a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.160262 Sep 13 20:04:32.355753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1193/2375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:32.508315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:32.508916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:32.515304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:32.515782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:32.516361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:32.517098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:32.517545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:32.518140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:32.580031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:32.588100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ff5b0f90-f828-41a2-a56b-86b33794d131 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083684 Sep 13 20:04:32.588671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1183/2376] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:33.378584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:33.379237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:33.386470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:33.386941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:33.387361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:33.388037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:33.388476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:33.388888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:33.523710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:33.531715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-217911a2-9771-4ef2-8d68-65182c9f009d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156967 Sep 13 20:04:33.532287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1194/2377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:33.611116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:33.611705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:33.618299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:33.618779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:33.619212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:33.620410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:33.620862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:33.621279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:33.683217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:33.690794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cfbd6a3e-ef68-4eb5-ba38-b3480c924064 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083675 Sep 13 20:04:33.691361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1184/2378] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:34.554796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:34.555408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:34.562370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:34.562844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:34.563275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:34.563953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:34.564404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:34.564825 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:34.704954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:34.713799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-47d00a47-d505-434a-a87f-3900956f9e40 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162721 Sep 13 20:04:34.714267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:34.714731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1195/2379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:34.714912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:34.721428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:34.721936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:34.722367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:34.723061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:34.723510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:34.723944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:34.788100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:34.796502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-febb25a0-95f3-4503-b7ed-537f0f85c907 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086224 Sep 13 20:04:34.797069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1185/2380] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:34 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:35.738320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:35.738917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:35.745713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:35.746188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:35.746615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:35.747287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:35.747725 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:35.748139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:35.820127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:35.820922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:35.827475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:35.827957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:35.828390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:35.829085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:35.829531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:35.829975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:35.904165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:35.908885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:35.912086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-79929646-b79e-4436-8f2e-45d18ef72d4a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096077 Sep 13 20:04:35.912943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1186/2381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:35.917595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dea1ec59-8ef5-4275-ba0f-63d1f06ac9a3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.183262 Sep 13 20:04:35.918187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1196/2382] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:36.935792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:36.936425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:36.940147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:36.940752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:36.942824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:36.943301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:36.943731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:36.944416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:36.944861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:36.945395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:36.947122 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:36.947603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:36.948031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:36.948712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:36.949156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:36.949577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:37.030540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:37.038342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-174e05be-f6ac-45ee-a695-e7d00c20055a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.106947 Sep 13 20:04:37.038914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1187/2383] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:37.104384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:37.112502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c2ec2744-9883-47d9-826f-f22acbc1973d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176276 Sep 13 20:04:37.113078 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1197/2384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:38.065269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:38.066373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:38.070066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=56 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:38.079864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:38.080776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:38.081644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:38.082871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:38.083568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:38.084220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:38.137071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:38.138010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:38.144653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=52 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:38.151072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:38.151828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:38.152377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:38.153082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:38.154084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:38.154084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:38.156214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:38.164377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ba818794-e660-498c-839b-c3f9ce753e97 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105681 Sep 13 20:04:38.164970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1188/2385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:38.288377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:38.296094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5c882c61-09d2-45b8-9139-953ee81c9926 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.163583 Sep 13 20:04:38.296666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1198/2386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:39.187947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:39.188588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:39.195097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:39.195612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:39.196378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:39.196746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:39.197194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:39.197636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:39.263265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:39.271251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-80037b50-e329-4f21-aa4b-d87d0202626c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087166 Sep 13 20:04:39.271740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1189/2387] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:39.320267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:39.320870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:39.327993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:39.328473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:39.328897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:39.329600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:39.330149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:39.330570 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:39.350748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:39.472254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:39.480308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fe7ebef8-f61c-47b6-bcaa-ed9045f6566d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164192 Sep 13 20:04:39.480880 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1199/2388] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:39 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:40.295031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:40.295628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:40.303789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:40.304271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:40.304697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:40.305376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:40.305848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:40.306279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:40.368947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:40.376982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e63d800-2d68-44c2-964e-2a97348ad9bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086059 Sep 13 20:04:40.377628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1190/2389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:40.504318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:40.504982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:40.511558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:40.512029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:40.512453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:40.513133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:40.513577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:40.514014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:40.656822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:40.665081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6c69285c-39f7-4e51-a41c-fcd065572b8f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164731 Sep 13 20:04:40.665704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1200/2390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:41.399883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:41.400482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:41.407275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:41.407750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:41.408182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:41.408887 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:41.409330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:41.409786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:41.482686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:41.490944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-50803146-bd64-42a7-a64e-4b8a58aad20b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094908 Sep 13 20:04:41.491677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1191/2391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:41.690716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:41.691333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:41.697899 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:41.698371 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:41.698801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:41.699471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:41.699937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:41.700348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:41.846042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:41.854749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eb911448-aac7-4120-8073-7f69fc9f3997 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167218 Sep 13 20:04:41.855343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1201/2392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:42.522792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:42.523415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:42.530291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:42.530770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:42.531201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:42.531884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:42.532323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:42.532734 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:42.606706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:42.614714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5667e7d5-9d70-43d2-ba51-5a7c231c3674 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095668 Sep 13 20:04:42.615289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1192/2393] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:42 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:42.878291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:42.878927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:42.885693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:42.886175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:42.886605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:42.887296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:42.887735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:42.888152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:43.045059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:43.052746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-844a9098-babb-4eda-bd86-f23385b4cf1a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.178413 Sep 13 20:04:43.053312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1202/2394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:43.638955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:43.639559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:43.646156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:43.646632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:43.647063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:43.647735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:43.648176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:43.648597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:43.725215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:43.743349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-179a059c-9eb4-466c-a989-07d182db23b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108661 Sep 13 20:04:43.744419 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1193/2395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:44.078692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:44.079327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:44.086224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:44.086758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:44.087130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:44.087828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:44.088270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:44.088730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:44.232133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:44.240528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b7d518a5-d8d9-42b0-bafa-55118e05eccb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165627 Sep 13 20:04:44.241109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1203/2396] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:44.771137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:44.772032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:44.779899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:44.780375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:44.780810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:44.781486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:44.781959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:44.782378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:44.852742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:44.861214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-250fa34c-8b1f-42f3-81d2-edcb292c6610 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094540 Sep 13 20:04:44.861779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1194/2397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:45.265173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:45.266151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:45.272465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:45.273222 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:45.273506 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:45.274131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:45.274574 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:45.275292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:45.415863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:45.424425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-40227d1e-7473-41c1-9816-f77131a2fc47 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.163227 Sep 13 20:04:45.425232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1204/2398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:45 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:45.891777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:45.892404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:45.906152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:45.906652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:45.907086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:45.907779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:45.908227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:45.908650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:45.974732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:45.982524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4197980b-1e11-4cec-8ab1-3eb9126bfedc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094609 Sep 13 20:04:45.983330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1195/2399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:46.449064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:46.449872 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:46.456316 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:46.456786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:46.457221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:46.457937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:46.458374 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:46.458790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:46.605521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:46.613775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-242ea0ae-0c8b-4645-bcfa-a33a4e97b257 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169123 Sep 13 20:04:46.614354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1205/2400] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:47.004906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:47.005516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:47.012010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:47.012653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:47.013093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:47.013822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:47.014267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:47.014691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:47.078088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:47.086818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fcf0fb16-7fbc-4012-abe3-c7f8e4f330b6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085928 Sep 13 20:04:47.087390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1196/2401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:47.637482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:47.638397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:47.646072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:47.647037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:47.647571 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:47.648732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:47.649659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:47.650369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:47.792253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:47.803012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3fda2836-6641-4d91-bbd9-c2be2fc331b1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169878 Sep 13 20:04:47.803568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1206/2402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:48.110567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:48.111168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:48.117720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:48.118355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:48.118789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:48.120069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:48.120516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:48.120932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:48.193970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:48.202356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-260b141f-46ac-4861-9294-fca2f2201b10 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095578 Sep 13 20:04:48.202935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1197/2403] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:48.827933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:48.828817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:48.835013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:48.835500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:48.835933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:48.836616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:48.837057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:48.837472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:48.982095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:48.990727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3f0946f3-a8fc-4506-928d-a4d496162f6d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167002 Sep 13 20:04:48.991311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1207/2404] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:49.225169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:49.225982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:49.232710 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:49.233186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:49.233675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:49.234406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:49.234852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:49.235296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:49.320123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:49.328840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-297a9643-33f1-4440-bb02-98ec9cbb015c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.107488 Sep 13 20:04:49.329427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1198/2405] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:50.014616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:50.015396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:50.022575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:50.022758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:50.023110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:50.023795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:50.024232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:50.024646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:50.168128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:50.178906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b6237999-34b1-42a0-808d-678cc8317f78 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167820 Sep 13 20:04:50.179910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1208/2406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:50.351858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:50.352453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:50.360211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:50.360692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:50.361145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:50.361851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:50.362295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:50.362714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:50.365942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:50.450930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:50.459276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5b3e0a7c-cee8-49ea-86ae-c2bbee63c11b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.111836 Sep 13 20:04:50.459862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1199/2407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:51.202465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:51.203060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:51.209525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:51.210025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:51.210452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:51.211124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:51.211566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:51.211971 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:51.355362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:51.364347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d5868e34-899a-4475-acbf-07fa638a11d9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165682 Sep 13 20:04:51.364913 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1209/2408] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:51 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:51.484020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:51.484566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:51.490969 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:51.491439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:51.491866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:51.492542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:51.492980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:51.493398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:51.562708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:51.575443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7e933a49-3fb2-4646-a4a0-6fa6c8a87652 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095365 Sep 13 20:04:51.576023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1200/2409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:52.391522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:52.392447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:52.399878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:52.400383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:52.400834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:52.401866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:52.402324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:52.402849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:52.579894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:52.594138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-42959874-9075-41ee-aa63-4e9e42ab041c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.208590 Sep 13 20:04:52.595247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1210/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:52.599823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:52.600422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:52.608702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:52.609565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:52.610266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:52.610995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:52.611455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:52.611951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:52.689142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:52.701889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c19e76f1-90e6-4ef2-8317-224d253ced39 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105926 Sep 13 20:04:52.702504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1201/2411] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:52 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:53.620422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:53.621072 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:53.628148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:53.628626 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:53.629066 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:53.629800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:53.630247 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:53.630668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:53.726534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:53.727127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:53.734444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:53.734928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:53.735366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:53.736063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:53.736713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:53.737134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:53.771075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:53.780104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a6a96d59-3784-49e9-9156-e700aaab2187 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164312 Sep 13 20:04:53.780690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1211/2412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:53.802872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:53.810878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-278817d9-635c-4cd5-af13-08aa7d394884 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088327 Sep 13 20:04:53.811461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1202/2413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:54.804047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:54.804702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:54.812087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:54.812558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:54.812986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:54.813694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:54.814137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:54.814554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:54.833517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:54.834190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:54.841250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:54.841810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:54.842347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:54.843189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:54.843747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:54.844078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:54.918641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:54.926848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-171ec1a2-643c-469f-9cf8-00978502e5ef tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097103 Sep 13 20:04:54.927438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1203/2414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:54.981997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:54.990161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cb1bfe42-1a71-4d7b-b628-027fb74e1da4 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.189853 Sep 13 20:04:54.990744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1212/2415] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:55.949441 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:55.950080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:55.956434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:55.956903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:55.957330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:55.958103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:55.958547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:55.958961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:56.012891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:56.013484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:56.020253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:56.020751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:56.021564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:56.021985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:56.022130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:56.022372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:56.022796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:56.030536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-47a6778d-fa41-4dd4-9f29-fea00575591b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085024 Sep 13 20:04:56.031107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1204/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:56.173047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:56.180830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-67b146f4-7c3e-4f16-81bf-613fd1ccead3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.171956 Sep 13 20:04:56.181432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1213/2417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:57.053860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:57.054470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:57.061476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:57.062001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:57.062439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:57.063136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:57.063584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:57.064010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:57.128053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:57.135884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-04cc8ee4-2413-4d0d-8b5e-5a8eff6de0d8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085831 Sep 13 20:04:57.136467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1205/2418] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:57.203865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:57.204455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:57.211016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:57.211488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:57.211910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:57.212580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:57.213017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:57.213430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:57.347484 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:57.355768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-00d402c3-54ec-4c73-9fac-65793ffea97d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155787 Sep 13 20:04:57.356326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1214/2419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:57 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:58.157776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:58.158382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:58.164878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:58.165356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:58.165853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:58.166531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:58.166977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:58.167396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:58.229530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:58.237371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-229d9d88-f13e-4575-8ff0-a37e5d9b2a41 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083479 Sep 13 20:04:58.237959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1206/2420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:58.379365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:58.380102 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:58.387349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:58.387838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:58.388281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:58.388982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:58.389432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:58.389894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:58.538218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:58.545994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0d81d036-d166-4e17-a652-cb1163dde00d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170638 Sep 13 20:04:58.546566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1215/2421] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:59.259511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:59.260123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:59.266539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:59.267018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:59.267454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:59.268138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:59.268590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:59.269015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:59.334903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:59.345601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f388efe3-03a1-42ff-9b00-5f8b335f1175 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089904 Sep 13 20:04:59.346242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1207/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:59.578186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:59.580997 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:59.585272 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:59.585799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:59.586397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:59.587077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:59.587586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:59.588530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:59.591164 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:59.728013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:59.735843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b2abe7a1-c3c0-4c46-b190-16c8db8eb417 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.161594 Sep 13 20:04:59.736405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1216/2423] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:00.368519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:00.369733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:00.376905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:00.377396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:00.377913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:00.378611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:00.379068 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:00.379495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:00.443573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:00.452076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0e7747e5-d787-4f91-bc66-b466847c6678 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087674 Sep 13 20:05:00.452660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1208/2424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:00.764646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:00.765375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:00.771632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:00.772205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:00.772518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:00.773204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:00.773676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:00.774303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:00.917910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:00.925854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b847845b-f32a-44f8-af67-cb558fd921e0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165040 Sep 13 20:05:00.926516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1217/2425] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:01.476040 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:01.476706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:01.483435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:01.483989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:01.484423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:01.485224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:01.485687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:01.486115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:01.550639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:01.559178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-776c03a7-c04d-4520-8664-28c640ede7f2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087335 Sep 13 20:05:01.559743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1209/2426] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:01 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:01.949280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:01.949930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:01.956839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:01.957331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:01.957795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:01.958478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:01.958925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:01.959346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:02.094882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:02.102494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-73cc7b65-a2f1-4d10-b236-1ed5a5841ffc tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157109 Sep 13 20:05:02.103671 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1218/2427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:02.582076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:02.582823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:02.590106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:02.590597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:02.591033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:02.591729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:02.592173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:02.592598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:02.659348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:02.667434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0a2e67af-b722-44c9-89f6-b50229d1e345 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089119 Sep 13 20:05:02.668011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1210/2428] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:03.126084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:03.126812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:03.133779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:03.134262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:03.134697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:03.135391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:03.135834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:03.136253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:03.281892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:03.289861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cde2dbf1-7acd-46e2-b780-6b6a8be16d96 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167579 Sep 13 20:05:03.290934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1219/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:03.691211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:03.692468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:03.699454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:03.699935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:03.700365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:03.701045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:03.701492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:03.701940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:03.765950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:03.773550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3f534352-263b-45c0-878b-2dec59f155c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086204 Sep 13 20:05:03.774136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1211/2430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:04.314307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:04.314866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:04.321207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:04.322398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:04.322824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:04.323498 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:04.323942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:04.324358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:04.454492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:04.462266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f93c825f-79b2-4876-ae7c-88a80fa4ad22 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.152149 Sep 13 20:05:04.462957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1220/2431] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:04.797278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:04.797970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:04.804750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:04.805231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:04.805695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:04.807052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:04.807490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:04.807918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:04.869689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:04.880580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f15a5597-a215-4c50-98b5-d75bc5bfb606 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.087071 Sep 13 20:05:04.881164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1212/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:05.486009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:05.486617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:05.493056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:05.493563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:05.494039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:05.494717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:05.495166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:05.495587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:05.628418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:05.637052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e8da4f4e-6b19-46ad-a378-dcb7c964e129 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.154877 Sep 13 20:05:05.637640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1221/2433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:05.905633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:05.906296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:05.912889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:05.913380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:05.913849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:05.914545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:05.914998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:05.915486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:05.977770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:05.985967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f8ed4d8d-7e71-4a24-a5d0-405e4d17ce65 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084156 Sep 13 20:05:05.986538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1213/2434] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:06.660699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:06.661358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:06.668807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:06.669282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:06.669739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:06.670417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:06.670863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:06.671283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:06.802180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:06.809882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0f61bfb6-74bf-47cf-8f0c-45bbbe405e60 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.153153 Sep 13 20:05:06.810450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1222/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:07.008467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:07.009532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:07.016286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:07.016767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:07.017196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:07.017907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:07.018352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:07.018768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:07.082620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:07.093502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9bd113ed-ce5d-4322-b34d-d43104ea0a2a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088839 Sep 13 20:05:07.094364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1214/2436] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:07.833481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:07.834163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:07.840660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:07.841135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:07.841568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:07.842283 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:07.842735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:07.843183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:07.979780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:07.987621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-66049df0-a0a2-4de1-b5d8-b4b4e140d2ff tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157931 Sep 13 20:05:07.988187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1223/2437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:08.123720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:08.124428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:08.126883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=54 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:08.132214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:08.132700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:08.133142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:08.133856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:08.134306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:08.134723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:08.196799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:08.199128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:08.206101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-44caf4f4-4374-494c-977b-9075943e8a9a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086191 Sep 13 20:05:08.206667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1215/2438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:08 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:09.010890 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:09.011527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:09.013891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=52 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:09.019138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:09.019612 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:09.020037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:09.020717 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:09.021156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:09.021569 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:09.153669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:09.161508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-04183bbc-170d-43a0-b32c-6ddf58c9fd67 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.154485 Sep 13 20:05:09.162096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1224/2439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:09 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:09.229185 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:09.229821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:09.236131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:09.236602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:09.237032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:09.237882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:09.238322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:09.238737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:09.299868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:09.307520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b4ad7d17-2785-47ba-a007-5abb5f1c1d2c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.082180 Sep 13 20:05:09.308079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1216/2440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:09 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:10.184926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:10.185560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:10.192056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:10.192528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:10.192956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:10.193644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:10.194094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:10.194515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:10.327886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:10.331715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:10.332354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:10.335617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0575768d-0506-4ca1-856a-9d6e1678802f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155123 Sep 13 20:05:10.336204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1225/2441] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:10.338791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:10.339272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:10.339704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:10.340383 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:10.340831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:10.341252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:10.656089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:10.663941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fce6d433-32a1-409b-bd66-3c13975f67a3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.336840 Sep 13 20:05:10.664512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1217/2442] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:10 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:11.359515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:11.360096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:11.366346 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:11.366817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:11.367244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:11.367909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:11.368387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:11.368795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:11.499975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:11.507697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5f515d14-5b79-4928-855e-c57be083e1d3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.151930 Sep 13 20:05:11.508260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1226/2443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:11.687205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:11.687826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:11.694302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:11.694783 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:11.695220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:11.695896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:11.697037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:11.697640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:11.764053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:11.774250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-384e95bd-1dd2-4db5-9541-08c00346d740 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090753 Sep 13 20:05:11.774855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1218/2444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:11 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:12.532106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:12.532849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:12.539287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:12.539761 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:12.541056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:12.542114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:12.542578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:12.542996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:12.688188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:12.698089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-42505974-225e-4fb5-bc2b-b42868d0b493 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170017 Sep 13 20:05:12.698655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1227/2445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:12.798027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:12.798698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:12.805691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:12.806179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:12.806634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:12.807315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:12.807762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:12.808183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:12.872063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:12.880098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d28ec9a6-491f-4e87-aebc-008d4502507f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085820 Sep 13 20:05:12.880754 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1219/2446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:12 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:13.721891 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:13.722504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:13.729496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:13.730009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:13.730444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:13.731127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:13.731576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:13.731998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:13.871917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:13.879666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f3837a0f-8f90-49d1-9e51-3beb23f72030 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.161742 Sep 13 20:05:13.880261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1228/2447] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:13.903848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:13.904467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:13.910875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:13.911356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:13.911793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:13.912476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:13.912929 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:13.913355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:13.973164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:13.980918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-219865df-1ec7-44a1-9cb4-75683bf5c470 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081754 Sep 13 20:05:13.981485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1220/2448] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:13 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:14.904126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:14.904773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:14.911165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:14.911648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:14.912081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:14.912754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:14.913204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:14.913651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:15.003631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:15.004243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:15.011282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:15.011775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:15.012206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:15.013129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:15.013577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:15.014259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:15.052265 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:15.059991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-13108821-d617-4650-a7b4-cbf5d2dfb094 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159940 Sep 13 20:05:15.060567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1229/2449] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:15.080081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:15.088503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b2c4f93a-a013-4903-b09f-3a5ead169854 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.088712 Sep 13 20:05:15.089067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1221/2450] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:14 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:16.083641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:16.084252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:16.090706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:16.091186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:16.091621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:16.092299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:16.092747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:16.093169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:16.110016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:16.110658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:16.117127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:16.117658 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:16.118693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:16.119382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:16.119831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:16.120270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:16.193557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:16.203284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b764c27a-a8d4-4009-acec-d92ff9c5b03c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.097053 Sep 13 20:05:16.203861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1222/2451] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:16 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:16.259096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:16.266930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ba9ee406-2065-4ce5-81a2-77be48f27cea tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.187138 Sep 13 20:05:16.267504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1230/2452] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:17.226220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:17.226826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:17.233867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:17.234347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:17.234776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:17.235459 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:17.235903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:17.236320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:17.291430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:17.292023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:17.298235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:17.298676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:17.299157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:17.299581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:17.300263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:17.300706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:17.301121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:17.306283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c773d480-150b-421a-ab68-b4d20b5fc5b0 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083660 Sep 13 20:05:17.306860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1223/2453] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:17 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:17.434679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:17.442708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-97a4c4f3-b9d5-449a-9591-a1134f7aa179 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155799 Sep 13 20:05:17.443288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1231/2454] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:18.329279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:18.329861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:18.336446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:18.336926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:18.337358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:18.338058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:18.338505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:18.338923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:18.400780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:18.408497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f2b93ffd-0f44-4867-bea9-3e674283497a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083142 Sep 13 20:05:18.409060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1224/2455] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:18 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:18.466705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:18.467315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:18.473278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:18.473787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:18.474218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:18.474885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:18.475324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:18.475737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:18.619726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:18.625859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:18.632840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a5f14e89-4103-4763-a969-15a2890fbbdf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169871 Sep 13 20:05:18.633418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1232/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:19.432497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:19.433087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:19.439617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:19.440102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:19.440535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:19.441207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:19.441670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:19.442088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:19.505329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:19.513583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-11e6171f-2aa6-4bde-9be0-567c35cebfed tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085705 Sep 13 20:05:19.514155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1225/2457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:19 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:19.656775 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:19.657516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:19.664256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:19.665238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:19.665690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:19.666363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:19.666808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:19.667218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:19.811620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:19.819523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-60716fd8-a3b6-438c-8928-f350c0bbaaca tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.166834 Sep 13 20:05:19.820095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1233/2458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:20.536099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:20.536842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:20.543070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:20.543544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:20.543973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:20.544642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:20.545085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:20.545504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:20.606523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:20.614140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ababae3c-0e33-4618-ade8-16f3f27e808f tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.081848 Sep 13 20:05:20.614721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1226/2459] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:20 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:20.842906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:20.843580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:20.850100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:20.850584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:20.851016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:20.851722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:20.852186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:20.852607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:20.982687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:20.990320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f50aa68d-7725-4ac0-a4ab-e2647c250fed tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.151373 Sep 13 20:05:20.990916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1234/2460] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:21.638537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:21.639144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:21.645656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:21.646062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:21.646494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:21.647166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:21.647610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:21.648024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:21.709096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:21.717493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6621fe1b-8f88-4f3b-a1f9-1c18060129d6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084194 Sep 13 20:05:21.718093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1227/2461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:21 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:22.014557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:22.015121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:22.022105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:22.022674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:22.023182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:22.023941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:22.024383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:22.024799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:22.161667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:22.169561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-211b4945-2dd6-4078-a16e-d939558bead5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159596 Sep 13 20:05:22.170156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1235/2462] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:22.740652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:22.741249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:22.748300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:22.748778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:22.749211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:22.749935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:22.750393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:22.750802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:22.814751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:22.822599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d98076f1-9ae3-4d39-9c1c-f8eb11b5cde6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085884 Sep 13 20:05:22.823165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1228/2463] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:22 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:23.192419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:23.193044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:23.200326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:23.200794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:23.201220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:23.201920 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:23.202373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:23.202783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:23.337280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:23.345185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-dfa7d8a3-faa1-4cd1-9dba-e4e58bd567c3 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156703 Sep 13 20:05:23.345782 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1236/2464] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:23.845473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:23.846129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:23.854253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:23.854728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:23.855158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:23.855838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:23.856278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:23.856695 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:23.919210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:23.926938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-596f8f38-1b88-4873-a78b-4d56df693171 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085347 Sep 13 20:05:23.927494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1229/2465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:23 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:24.371311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:24.372246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:24.382909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:24.383733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:24.384566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:24.385767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:24.386563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:24.387315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:24.534231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:24.542205 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b66b8e97-3e1c-4215-949c-b029e05fcf74 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.177467 Sep 13 20:05:24.542766 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1237/2466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:24.949767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:24.950378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:24.956787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:24.957267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:24.957714 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:24.958394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:24.958840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:24.959259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:25.023599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:25.031615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-21342bd2-9842-4b9c-95b1-df0fff2eb299 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085748 Sep 13 20:05:25.032175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1230/2467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:24 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:25.570567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:25.571246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:25.579547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:25.580301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:25.581091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:25.582401 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:25.583007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:25.583437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:25.726975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:25.735221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e7ea2c3e-884c-4767-b5b1-b67b8f246df0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.172169 Sep 13 20:05:25.735783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1238/2468] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:26.057770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:26.058367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:26.064398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:26.064880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:26.065306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:26.066024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:26.066464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:26.066881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:26.141481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:26.149340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-039cadf4-d320-4a62-9b85-5ec9a7f733bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098770 Sep 13 20:05:26.149940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1231/2469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:26 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:26.760841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:26.761499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:26.768182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:26.768660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:26.769091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:26.769817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:26.770279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:26.770699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:26.917747 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:26.925978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e7c5c239-535e-4ab0-86fb-15295738ac9e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170431 Sep 13 20:05:26.926575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1239/2470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:27.173684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:27.174527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:27.182605 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:27.183149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:27.184169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:27.184994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:27.185491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:27.185991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:27.202011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:27.252298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:27.264529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-716b22c2-49a7-4346-89aa-2e6683d3f88b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094923 Sep 13 20:05:27.265474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1232/2471] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:27 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:27.949771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:27.950379 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:27.960243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:27.961002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:27.962820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:27.962820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:27.962820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:27.963312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:28.123176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:28.131483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8e1fbb8a-fb6e-4eef-8403-ba516cdff093 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.185575 Sep 13 20:05:28.132069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1240/2472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:27 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:28.289361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:28.290086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:28.301992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:28.302478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:28.302911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:28.303596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:28.304043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:28.304457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:28.371933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:28.379838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-68381966-3230-4e43-8624-1eae85a8af13 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094424 Sep 13 20:05:28.380420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1233/2473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:28 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:29.163946 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:29.164981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:29.172409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:29.172883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:29.173312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:29.174024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:29.174490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:29.174908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:29.338144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:29.352064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ce1bf7a2-6e83-4a9a-8739-9bcc2169d48e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193213 Sep 13 20:05:29.353705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1241/2474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:29.402677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:29.403596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:29.410078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:29.410610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:29.411055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:29.412173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:29.412923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:29.413600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:29.479841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:29.487963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9a5951e0-e984-4564-a7e6-6415a718ccf4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089365 Sep 13 20:05:29.488563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1234/2475] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:29 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:30.381785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:30.382411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:30.389655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:30.390129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:30.390559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:30.391264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:30.391711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:30.392128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:30.516896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:30.518045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:30.530608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:30.531281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:30.532067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:30.533324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:30.534190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:30.534922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:30.573703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:30.584994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-62860fac-cc73-46d6-8f71-29fd297dbe0c tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.206957 Sep 13 20:05:30.585578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1242/2476] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:30.609157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:30.621990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-df2a7753-f089-4b7b-a52a-4dbb2a6ab7e6 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.113175 Sep 13 20:05:30.622585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1235/2477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:30 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:31.616052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:31.619649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:31.626508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:31.626996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:31.627439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:31.628154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:31.628615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:31.629047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:31.646163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:31.646793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:31.654049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:31.654770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:31.655242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:31.655837 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:31.656520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:31.656720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:31.750774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:31.763039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b6a70799-354d-445c-bd03-ba0d1ac13ef2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.120455 Sep 13 20:05:31.764010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1236/2478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:31 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:31.826213 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:31.834545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-90530ba3-151e-4a9b-bae0-6e839b6cf3b5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.224618 Sep 13 20:05:31.835246 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1243/2479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:32.798143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:32.798802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:32.808693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:32.809190 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:32.809634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:32.810343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:32.810786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:32.811200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:32.858104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:32.858942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:32.866284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:32.866854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:32.867438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:32.868245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:32.868864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:32.869383 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:32.884339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:32.893820 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-990f5eba-1fa8-414e-9aa4-b4dfbaf688e7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099535 Sep 13 20:05:32.894502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1237/2480] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:32 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:33.046304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:33.055295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e8a9c4b3-422e-40ee-bb80-0e5e1a9e19ad tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.201139 Sep 13 20:05:33.055772 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1244/2481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:32 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:33.936999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:33.937598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:33.951368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:33.951874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:33.952313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:33.953148 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:33.953520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:33.953993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:34.029782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:34.038160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-55f46a93-9d6c-40a0-a811-9c46fb6ecb70 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.105145 Sep 13 20:05:34.038751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1238/2482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:33 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:34.083380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:34.084008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:34.091201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:34.091688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:34.092121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:34.092811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:34.093255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:34.093769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:34.244156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:34.254342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-48bbb318-261e-4e64-bd61-64bd34f384e9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.174636 Sep 13 20:05:34.255174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1245/2483] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:35.203932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:35.204858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:35.212391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:35.212880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:35.213307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:35.214053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:35.214491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:35.214910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:35.282416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:35.283970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:35.285262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:35.291077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:35.291563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:35.292004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:35.292708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:35.293156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:35.293581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:35.294119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-452fc607-9bc2-45d0-9449-f903b90a1890 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.234538 Sep 13 20:05:35.294699 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1239/2484] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:35 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:35.443482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:35.451278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ba4add61-59f3-47c5-981f-8d8ed3ee2fd8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.172942 Sep 13 20:05:35.451852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1246/2485] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:36.328623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:36.329270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:36.335765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:36.336250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:36.336685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:36.338030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:36.338482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:36.338906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:36.416235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:36.425885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7992c2fd-d940-4aa5-b36d-989edc3fe1f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101739 Sep 13 20:05:36.426651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1240/2486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:36 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:36.475418 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:36.476063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:36.482965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:36.483753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:36.483884 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:36.484598 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:36.485091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:36.485477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:36.628659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:36.637702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-717baca6-914e-4d33-8a3a-9af862d3a7aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.166225 Sep 13 20:05:36.638304 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1247/2487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:37.450045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:37.450829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:37.457944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:37.458540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:37.459045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:37.459869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:37.460384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:37.460881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:37.530955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:37.540891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aba437eb-f3ac-424b-9b06-1638ccc811d4 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094247 Sep 13 20:05:37.541478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1241/2488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:37 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:37.660821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:37.661421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:37.668938 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:37.669425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:37.669940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:37.670644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:37.671177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:37.671654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:37.822483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:37.830813 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-21c19524-ea49-431a-89d8-3ccf1b5deeda tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.174090 Sep 13 20:05:37.831413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1248/2489] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:38.568100 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:38.569128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:38.573032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=54 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:38.580391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:38.580878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:38.581431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:38.582165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:38.582613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:38.583035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:38.648346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:38.656967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8b1d2681-f229-4b99-b557-21084ad5ca6b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095538 Sep 13 20:05:38.657531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1242/2490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:38 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:38.855412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:38.855978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:38.862768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:38.863243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:38.863674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:38.864362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:38.864802 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:38.865219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:38.880483 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:39.000100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:39.008589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5db809ce-453c-43d7-a02b-1588c6030656 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157452 Sep 13 20:05:39.010056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1249/2491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:39.683283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:39.683905 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:39.690400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:39.690909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:39.691343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:39.692025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:39.692471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:39.692891 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:39.763318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:39.772488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fca8397e-ad9f-4a2d-aefd-c2b979cbf6f1 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093796 Sep 13 20:05:39.773096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1243/2492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:39 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:40.033584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:40.034439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:40.036903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=52 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:40.043203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:40.043692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:40.044191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:40.044906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:40.045357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:40.045807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:40.219742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:40.230186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-adf00a97-c323-4470-8956-9d756f7bc669 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.200738 Sep 13 20:05:40.230940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1250/2493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:40.796473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:40.797094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:40.803889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:40.804367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:40.804799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:40.805486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:40.805961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:40.806377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:40.871417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:40.879227 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-48d9944b-134c-4fb1-8c97-1748344761d2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086586 Sep 13 20:05:40.879804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1244/2494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:40 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:41.254871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:41.255480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:41.262642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:41.263119 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:41.263545 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:41.264238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:41.264687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:41.265106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:41.433151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:41.441822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ab00022b-52a5-4e5a-854c-408c3a277312 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.190732 Sep 13 20:05:41.442897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1251/2495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:41.903303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:41.903948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:41.910415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:41.910889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:41.911323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:41.912007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:41.912455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:41.912879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:41.975250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:41.982949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6dce0943-3761-4e68-953e-bb99b6c78629 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.084248 Sep 13 20:05:41.983519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1245/2496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:41 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:42.464936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:42.465537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:42.472063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:42.472535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:42.472957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:42.473642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:42.474089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:42.474503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:42.607186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:42.618173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9e1c75cf-d6e9-46da-8ba0-45a89b17f77b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157363 Sep 13 20:05:42.618990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1252/2497] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:43.006062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:43.006681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:43.013823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:43.014309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:43.014752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:43.015447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:43.015896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:43.016316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:43.090196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:43.097960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c9e59c38-b152-4bec-bdae-b599dadffa99 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095757 Sep 13 20:05:43.098532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1246/2498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:43 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:43.641965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:43.642600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:43.650050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:43.650532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:43.650992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:43.651673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:43.652116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:43.652604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:43.786792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:43.795251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6f347014-d6f3-465f-aeda-ac40aeddc6d6 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157269 Sep 13 20:05:43.795847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1253/2499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:44.121843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:44.122767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:44.130191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:44.130684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:44.131150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:44.131853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:44.132306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:44.132724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:44.203499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:44.211520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e09d977-d126-4b08-82cd-665f6938aa38 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.094266 Sep 13 20:05:44.212101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1247/2500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:44 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:44.819931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:44.820539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:44.827313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:44.827798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:44.828236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:44.828930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:44.829385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:44.829838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:44.975036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:44.982976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-12b13ded-8728-4e40-a9df-582bd7e46e86 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167697 Sep 13 20:05:44.983549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1254/2501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:45.234975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:45.235578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:45.242220 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:45.243339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:45.243790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:45.244475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:45.244924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:45.245345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:45.306597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:45.314410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-30e5d323-163a-4a99-aec3-51f9733765a5 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.083523 Sep 13 20:05:45.314985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1248/2502] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:45 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:46.005769 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:46.006389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:46.013428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:46.013931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:46.014360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:46.015040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:46.015482 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:46.016003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:46.145716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:46.155123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-439deefe-c8b8-49b3-891a-2ed21e4532af tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.153187 Sep 13 20:05:46.155697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1255/2503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:46.337422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:46.338022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:46.344380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:46.344857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:46.345284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:46.345981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:46.346425 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:46.346844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:46.350702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:46.412072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:46.420345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2e077e1a-5686-4c0c-9c12-dc81a73994bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.086928 Sep 13 20:05:46.420904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1249/2504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:46 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:47.179743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:47.180991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:47.183031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:05:47.183207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:05:47.190818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:47.191306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:47.192040 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:47.193310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:47.194055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:47.194525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:47.345384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:47.354794 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a78b36b9-5693-4aa0-84d3-fce592834c70 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.178969 Sep 13 20:05:47.355377 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1256/2505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:47.450098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:47.451157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:47.462701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:47.463189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:47.463621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:47.464315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:47.464755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:47.465168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:47.532539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:47.544375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-72e65ae3-6bb5-4801-9b34-1368fca25d37 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.104683 Sep 13 20:05:47.545524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1250/2506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:47 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:48.378387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:48.378981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:48.386320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:48.386814 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:48.387249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:48.387934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:48.388375 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:48.388798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:48.526252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:48.534231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7ac7f71c-c7ab-49d3-8c27-6e29173d6cfb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159519 Sep 13 20:05:48.534803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1257/2507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:48.568608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:48.569216 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:48.576301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:48.576785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:48.577226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:48.577945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:48.578394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:48.578819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:48.642197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:48.650463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f557b2c8-087e-40a3-8d63-b4bb6d2499bc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.085779 Sep 13 20:05:48.651036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1251/2508] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:48 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:49.557404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:49.558056 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:49.565872 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:49.566397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:49.566831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:49.567529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:49.567980 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:49.568393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:49.673401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:49.674132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:49.684988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:49.686414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:49.687452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:49.688985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:49.690079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:49.690872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:49.737231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:49.746905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2c8e105b-f3df-4588-94af-5be4e030f595 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193289 Sep 13 20:05:49.747502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1258/2509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:49.783737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:49.792359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f36991fb-768f-4851-9b43-c6ccad26665c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.122907 Sep 13 20:05:49.792920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1252/2510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:49 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:50.773520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:50.774393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:50.782805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:50.783281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:50.783733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:50.784462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:50.784901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:50.785318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:50.821906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:50.823095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:50.829859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:50.830361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:50.830792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:50.831500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:50.831958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:50.832571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:50.916092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:50.924981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-de01c33a-9477-40c8-b9ac-a9b72669bc60 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.108289 Sep 13 20:05:50.925423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1253/2511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:50 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:50.968057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:50.976281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5143e226-7994-4b5a-b0ea-78ea15da1db8 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.208781 Sep 13 20:05:50.976855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1259/2512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:51.948530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:51.949187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:51.956492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:51.957122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:51.957784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:51.958779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:51.959339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:51.959866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:52.015059 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:52.016148 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:52.028678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:52.028926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:52.029438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:52.030154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:52.031347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:52.032146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:52.032882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:52.037261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4dd7b505-7c43-4d13-adf4-354bf2bc0cbc tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.092607 Sep 13 20:05:52.037885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1254/2513] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:51 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:52.226801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:52.238777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1dbd8ffe-074a-4da7-a335-99e674198250 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.233687 Sep 13 20:05:52.239368 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1260/2514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:53.063303 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:53.064003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:53.070701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:53.071211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:53.071644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:53.073135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:53.073619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:53.074065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:53.142462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:53.152544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f466fb75-0798-452f-8c6b-4c3e563131de tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.093170 Sep 13 20:05:53.153166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1255/2515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:53 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:53.265958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:53.266762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:53.273399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:53.274091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:53.274423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:53.275425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:53.275883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:53.276302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:53.417344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:53.425488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e981978f-f95a-4445-b788-4adc3e07f3ab tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164044 Sep 13 20:05:53.426105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1261/2516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:54.178408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:54.179433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:54.189899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:54.190677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:54.191284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:54.192496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:54.193036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:54.193468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:54.262998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:54.271499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dbbd0979-6fb5-42a5-8292-f8d9d843c2ce tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.098823 Sep 13 20:05:54.271996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1256/2517] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:54 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:54.454892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:54.456816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:54.462967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:54.463475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:54.463898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:54.464602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:54.465050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:54.465472 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:54.643378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:54.652063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0bb2534-5977-4a98-90fd-2a1516b5fb04 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.207350 Sep 13 20:05:54.652854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1262/2518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:55.295493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:55.296330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:55.302342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:55.303143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:55.303323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:55.303923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:55.304372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:55.304794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:55.377927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:55.385784 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d26fd815-84e8-4cb6-ae55-99813d493f5a tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.095746 Sep 13 20:05:55.386355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1257/2519] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:55 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:55.676847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:55.677862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:55.685351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:55.685882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:55.686312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:55.687027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:55.687480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:55.687901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:55.855449 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:55.866038 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-93a42049-7cfb-41f7-aeb4-3ffec67f2f9f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193543 Sep 13 20:05:55.866629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1263/2520] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:56.417158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:56.417854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:56.427055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:56.427542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:56.427971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:56.428671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:56.429119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:56.429536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:56.503662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:56.512266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-41be3a16-f454-42dd-86b6-3091f2bd96c2 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100663 Sep 13 20:05:56.512860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1258/2521] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:56 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:56.902292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:56.902908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:56.909390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:56.909914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:56.910363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:56.911087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:56.911538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:56.911958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:57.058750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:57.070211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-91d140d3-4ebd-423e-903a-01217854c979 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.171892 Sep 13 20:05:57.070815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1264/2522] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:57.547763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:57.548368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:57.558302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:57.558788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:57.559224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:57.559957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:57.561824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:57.562766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:57.631580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:57.640020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-87c01dcd-0eb5-407c-829b-d1c154a2cc56 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.096107 Sep 13 20:05:57.640594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1259/2523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:57 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:05:58.094977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:58.095637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:58.102282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:58.103296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:58.103730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:58.104417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:58.104860 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:58.105276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:58.249459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:58.257478 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-cfe3c23e-3b6d-4b4e-b2ba-2375a9526ec2 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167164 Sep 13 20:05:58.258079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1265/2524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:58.663469 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:58.664105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:58.671467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:58.671959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:58.672398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:58.673107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:58.673555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:58.674018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:58.740159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:58.749576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-53a07303-82e6-4e05-84d9-7b6c3e8477f7 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.089972 Sep 13 20:05:58.750382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1260/2525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:58 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:59.281258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:59.282136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:59.289084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:59.289587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:59.290048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:59.291298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:59.291755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:59.292168 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:59.295936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:59.439763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:59.448314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-17c034c0-c98a-422c-9dbf-c123e8e0aff1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170862 Sep 13 20:05:59.449299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1266/2526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:05:59.774088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:05:59.775467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:05:59.781884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:59.782361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:59.782789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:59.783462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:05:59.783907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:05:59.784323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:05:59.862129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:05:59.870023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8f6428b5-eaac-4273-8fae-738a9df4e12c tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.099707 Sep 13 20:05:59.870604 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1261/2527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:05:59 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:00.474169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:00.477497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:00.484369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:00.484894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:00.485335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:00.486085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:00.486538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:00.486960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:00.656353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:00.664486 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4a775419-a8c5-41ab-850d-2b596e582a81 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.196235 Sep 13 20:06:00.665091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1267/2528] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:00.893197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:00.893862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:00.900701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:00.901187 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:00.901643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:00.902334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:00.902786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:00.903206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:01.003607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:01.011716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9b846ab8-0c6b-4fd5-9252-92bbe2580bd9 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.122369 Sep 13 20:06:01.012284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1262/2529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:00 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:01.688682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:01.689520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:01.697393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:01.697943 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:01.698378 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:01.699082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:01.699526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:01.699965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:01.869107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:01.877231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9a8541c7-78bc-4e6d-ac42-481a34229a11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.192574 Sep 13 20:06:01.877861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1268/2530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:02.034941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:02.035778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:02.037554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:06:02.037756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:06:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b (ip 10.222.0.23) !!! Sep 13 20:06:02.050295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:02.050787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:02.051601 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:02.051960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:02.052434 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:02.052853 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:02.143500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:02.162356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-668ba843-98f7-4df4-a51a-f5d5d7588466 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.131240 Sep 13 20:06:02.162944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1263/2531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:02 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:02.902294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:02.902908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:02.905320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:06:02.905453 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:06:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:06:02.912185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:02.912669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:02.913103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:02.913834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:02.914286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:02.914707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:03.061900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:03.070427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-563d5c36-455f-43ca-833a-97f5640f77d1 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.172462 Sep 13 20:06:03.071018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1269/2532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:03.186155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:03.186753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:03.193234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:03.193756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:03.194223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:03.196526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:03.196526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:03.196526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:03.264732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:03.273132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f5d097c5-0513-41cb-8e46-86e90b521d24 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.090891 Sep 13 20:06:03.273735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1264/2533] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:03 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:04.093644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:04.094359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:04.101031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:04.101521 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:04.101983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:04.103172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:04.103621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:04.104043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:04.252667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:04.266415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c7075705-2bdd-4961-a0d8-3cb9eaab69eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.176272 Sep 13 20:06:04.267225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1270/2534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:04 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:04.296912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:04.297930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:04.307529 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:04.308234 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:04.308778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:04.309959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:04.310761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:04.311524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:04.380482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:04.382782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:04.393315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-49ed8897-3aef-4d60-b5ad-3bc13ae20dde tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.100147 Sep 13 20:06:04.395334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1265/2535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:04 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:05.292551 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:05.293382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:05.300852 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:05.301344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:05.301965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:05.302665 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:05.303112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:05.303527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:05.425804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:05.426410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:05.434135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:05.434616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:05.435255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:05.435962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:05.436408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:05.436827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:05.470743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:05.480307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f534b54b-c9ba-4083-9680-78d40eaef219 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.193067 Sep 13 20:06:05.480902 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1271/2536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:05.514521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:05.522958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fa0f2a71-e28b-42e8-8ac0-7a3f160c5adb tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.101018 Sep 13 20:06:05.523570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1266/2537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:05 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:06.504945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:06.505568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:06.513237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:06.513750 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:06.514178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:06.514861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:06.515310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:06.515767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:06.549748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:06.550696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:06.561317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:06.562120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:06.562753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:06.563799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:06.564516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:06.565122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:06.648764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:06.659753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f9c131ea-343b-4417-8b20-e895221ce4c8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.116234 Sep 13 20:06:06.660641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1267/2538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:06 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:06.702254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:06.710822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d07a771-edc1-452e-8225-c7cc4f90fdf0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.209825 Sep 13 20:06:06.711415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1272/2539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:07.686868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:07.687482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] [instance: 0cbec662-02ef-44f0-9a02-f2b8090a5c1b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:07.694182 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:07.694673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:07.695099 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:07.695787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:07.696350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:07.696779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:07.739196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:07.740447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:07.750875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:07.751744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:07.752524 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:07.753778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:07.754549 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:07.755302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:07.778347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e09b3554bb64828b857632d1de602d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f154705e31748d9b7b8455ee5f73b70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:07.786473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aed88635-0950-48ec-b840-510e0d3599dd tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b" status: 200 len: 1225 microversion: 2.1 time: 0.103398 Sep 13 20:06:07.788810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1268/2540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:07 2022] GET /compute/v2.1/servers/0cbec662-02ef-44f0-9a02-f2b8090a5c1b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:07.913402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:07.927617 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-14f6b944-6999-41b2-8f97-06013f948e65 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.196007 Sep 13 20:06:07.928605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1273/2541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:08.956082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:08.956745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:08.959300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=54 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:08.965466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:08.965981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:08.966421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:08.967126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:08.967576 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:08.968001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:09.118155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:09.126164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a5ea1b78-d4be-4304-bb95-95b26c10e3b9 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.173934 Sep 13 20:06:09.126751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1269/2542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:10.153542 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:10.154414 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:10.157390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=48 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:10.165788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:10.166352 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:10.166792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:10.167635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:10.168269 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:10.168849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:10.331698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:10.342713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bbfb7cb0-fc75-4391-8841-5aa00a835e32 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.195128 Sep 13 20:06:10.343318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1274/2543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:10 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:11.369334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:11.370479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:11.374736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:06:11.374949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:06:11.385616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:11.386369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:11.387077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:11.388142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:11.388851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:11.389437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:11.559176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:11.567171 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3cbb1a30-c4dc-42eb-8926-bf277b99818d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.203515 Sep 13 20:06:11.567738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1270/2544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:11 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:12.591131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:12.591798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:12.598451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:12.598931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:12.599365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:12.600088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:12.600535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:12.600954 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:12.749993 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:12.758738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-875add6a-9114-4e09-8a33-3e102b92b4a5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.171453 Sep 13 20:06:12.759329 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1275/2545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:12 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:13.782413 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:13.783063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:13.789545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:13.790053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:13.790511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:13.791192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:13.791634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:13.792049 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:13.938637 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:13.947860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-37966489-0402-41d9-aa82-33819ba4596b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169559 Sep 13 20:06:13.948426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1271/2546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:13 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:14.970823 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:14.971589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:14.978618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:14.979096 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:14.979529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:14.980209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:14.980655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:14.981073 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:15.124210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:15.137341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ba38a62e-423f-4a3a-871c-01094e779508 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170211 Sep 13 20:06:15.138344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1276/2547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:14 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:16.162256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:16.163090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:16.165957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:06:16.166137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:06:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f (ip 10.222.0.23) !!! Sep 13 20:06:16.173470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:16.173976 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:16.174410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:16.175137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:16.175584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:16.176200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:16.315796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:16.323960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d2fe10fb-b6e7-4b2e-8cdf-5202be4cf270 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165823 Sep 13 20:06:16.324545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1272/2548] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:16 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:17.347932 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:17.348680 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:17.355672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:17.356157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:17.356595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:17.357287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:17.357779 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:17.358209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:17.503444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:17.511396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-361d5f2a-8c7e-4205-a8b4-1bf8bca1a0eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.167416 Sep 13 20:06:17.511972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1277/2549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:17 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:18.534913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:18.535510 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:18.541677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:18.542167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:18.542610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:18.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:18.543740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:18.544160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:18.678886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:18.687643 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dbc8e07e-a100-412c-bf0e-8b951c470367 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156770 Sep 13 20:06:18.688224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1273/2550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:18 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:19.713580 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:19.714209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:19.720811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:19.721530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:19.722158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:19.722846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:19.723291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:19.723707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:19.864876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:19.873305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c838930e-4fc1-449b-b663-030b98b8a429 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164402 Sep 13 20:06:19.873921 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1278/2551] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:19 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:20.896572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:20.897270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:20.904872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:20.905352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:20.905862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:20.906579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:20.907023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:20.907444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:21.043590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:21.051562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bd374819-78d4-43c9-8038-1ac7dbc4fd4b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158815 Sep 13 20:06:21.052137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1274/2552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:20 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:22.075905 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:22.076531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:22.083145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:22.083619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:22.084047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:22.084731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:22.085169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:22.085584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:22.243525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:22.251811 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d335d99d-66b3-476b-ba3f-b7b0d44ba085 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.179560 Sep 13 20:06:22.252409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1279/2553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:22 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:23.276401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:23.276979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:23.283824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:23.284298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:23.284731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:23.285409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:23.285882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:23.286301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:23.428815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:23.436705 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3bc72ea8-3ef8-43af-9eb8-b4ed9c16b52f tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165336 Sep 13 20:06:23.437264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1275/2554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:23 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:24.460381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:24.461000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:24.467491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:24.467961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:24.468387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:24.469064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:24.469502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:24.469941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:24.618579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:24.626700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4f2c4524-54f0-49f5-aec0-c7c91d188ebf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170169 Sep 13 20:06:24.627384 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1280/2555] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:24 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:25.651210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:25.651815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:25.658313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:25.658799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:25.659229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:25.659911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:25.660353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:25.660771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:25.812139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:25.820179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-086bda94-d08c-4081-af3d-e4d041dec6de tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.173207 Sep 13 20:06:25.820755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1276/2556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:25 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:26.843739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:26.844335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:26.850933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:26.851413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:26.851840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:26.852516 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:26.852958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:26.853405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:26.989633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:26.998294 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3411c3b1-72f5-43e8-879a-2c89c188ce5b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158503 Sep 13 20:06:26.998869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1281/2557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:26 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:28.022495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:28.023120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:28.031163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:28.031790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:28.032329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:28.033134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:28.033716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:28.034272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:28.171933 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:28.180509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-650d0864-fb50-49e6-b447-394af6809ab7 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162092 Sep 13 20:06:28.181090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1277/2558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:28 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:29.204405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:29.205039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:29.212432 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:29.212917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:29.213349 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:29.214086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:29.214530 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:29.214948 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:29.358776 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:29.362033 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:29.370114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7d68afa5-c2f9-4de3-99e3-7accff34691a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169284 Sep 13 20:06:29.370708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1282/2559] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:29 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:30.394936 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:30.395580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:30.402861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:30.403341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:30.403781 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:30.404466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:30.404918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:30.405344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:30.541208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:30.550694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-05ec4d31-d809-4a67-b8a3-8949942462c5 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.159603 Sep 13 20:06:30.551294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1278/2560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:30 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:31.573818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:31.574654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:31.583252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:31.583753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:31.584194 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:31.584917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:31.585373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:31.585824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:31.981210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:31.989104 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-45e8f99f-4282-4f14-b720-73115ef09923 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.419171 Sep 13 20:06:31.989709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1283/2561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:31 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:33.013706 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:33.014670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:33.024412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:33.024901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:33.025346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:33.026065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:33.026512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:33.026930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:33.160828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:33.169869 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5638bd10-3838-469e-96a2-5e62b9ae6328 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.161342 Sep 13 20:06:33.170448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1279/2562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:33 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:34.193951 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:34.194640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:34.201740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:34.202223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:34.202666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:34.203357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:34.203815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:34.204238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:34.346751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:34.354944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b48aaf7b-e956-4d49-983e-14166c417d11 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.164854 Sep 13 20:06:34.355588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1284/2563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:34 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:35.379386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:35.380041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:35.386997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:35.387499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:35.387910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:35.388600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:35.389066 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:35.389479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:35.392341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=86 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:35.542574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:35.550722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-65bd63b3-6c9a-4248-8ab3-fe374bdcd041 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.175182 Sep 13 20:06:35.558242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1280/2564] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:35 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:36.577180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:36.577826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:36.584474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:36.584953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:36.585416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:36.586149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:36.586591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:36.587001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:36.734077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:36.742686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4d59398b-e347-4975-851c-5a67394bffbb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169688 Sep 13 20:06:36.743275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1285/2565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:36 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:37.765819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:37.766421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:37.776117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:37.776680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:37.777377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:37.778204 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:37.778655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:37.779074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:37.947084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:37.958816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5da62294-cf39-48d6-90ee-822c775fc872 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.196569 Sep 13 20:06:37.959796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1281/2566] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:37 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:38.984556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:38.985203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:38.992082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:38.992568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:38.993004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:38.993764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:38.994177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:38.994608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:39.142525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:39.151588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-65b6547e-b992-432c-b0f9-f3ae6de22eae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.170944 Sep 13 20:06:39.152169 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1286/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:38 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:40.175439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:40.176129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:40.179180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=26 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:40.185337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:40.185545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:40.186019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:40.186761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:40.187309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:40.187745 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:40.357496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:40.367908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34c3a39e-c6fc-480a-9e58-f8ea2001cae0 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.196381 Sep 13 20:06:40.368492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1282/2568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:40 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:41.391673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:41.392279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:41.394607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=26 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:41.401151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:41.401862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:41.402255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:41.402919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:41.403393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:41.403875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:41.545071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:41.552850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-953a00df-6e6f-48bf-a7ca-4a9da3fb838e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165079 Sep 13 20:06:41.553445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1287/2569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:41 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:42.576255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:42.576858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:42.583412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:42.583892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:42.584327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:42.585520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:42.585984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:42.586412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:42.724883 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:42.733466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34c68b4a-416b-412c-986e-19a2d1036854 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.161030 Sep 13 20:06:42.734091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1283/2570] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:42 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:06:43.756501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:43.757245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:43.763540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:43.764023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:43.764452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:43.765135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:43.765582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:43.766027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:43.901124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:43.909217 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8675cd36-a4d0-4683-b132-74983b09820d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156608 Sep 13 20:06:43.909827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1288/2571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:43 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:44.932537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:44.933232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:44.939636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:44.940112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:44.940536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:44.941212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:44.941676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:44.942097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:45.075567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:45.083777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-079e8eb7-b49b-4f19-a5ca-c49ed4e78cbf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155051 Sep 13 20:06:45.084349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1284/2572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:44 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:46.108048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:46.108690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:46.115145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:46.115613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:46.116619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:46.117312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:46.118021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:46.118176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:46.251399 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:46.259155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-812fec8c-bbc1-4a0c-9e65-69d1d51abe14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.154920 Sep 13 20:06:46.259732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1289/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:46 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:47.283365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:47.283965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:47.290671 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:47.291156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:47.291589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:47.292716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:47.293522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:47.294254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:47.433788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:47.442270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-59bcc27c-dbaa-46e3-b9eb-6c5003f71caf tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162995 Sep 13 20:06:47.442849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1285/2574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:47 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:48.465286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:48.465908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:48.471925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:48.472403 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:48.472835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:48.473557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:48.473994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:48.474422 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:48.617470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:48.627460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a64565fd-2dd9-40f6-9679-8b3f3ffb84db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.166060 Sep 13 20:06:48.628045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1290/2575] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:48 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:49.652388 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:49.652981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:49.659518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:49.659998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:49.660433 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:49.661111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:49.661561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:49.662009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:49.793997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:49.801765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bab64ce9-758f-47f6-9f16-71b7ec35061a tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.153424 Sep 13 20:06:49.802320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1286/2576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:49 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:50.825824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:50.826533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:50.834175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:50.834650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:50.835079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:50.835753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:50.836196 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:50.836607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:51.122411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:51.130170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-84eccdfa-d174-4498-b784-f147309b6d54 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.308293 Sep 13 20:06:51.130742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1291/2577] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:50 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:52.154030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:52.154631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:52.161805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:52.162285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:52.162849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:52.163528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:52.163970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:52.164387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:52.296579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:52.305634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7be5c538-1fdd-4154-a7bc-7a5b3ec53505 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155009 Sep 13 20:06:52.306396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1287/2578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:52 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:53.330089 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:53.330868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:53.337662 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:53.338147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:53.338579 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:53.339259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:53.339707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:53.341100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:53.477043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:53.486361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5b5c95af-3cc1-474a-89d3-57289cd19360 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.160282 Sep 13 20:06:53.486928 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1292/2579] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:53 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:54.509746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:54.510353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:54.517109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:54.517758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:54.518298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:54.519246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:54.519892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:54.520354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:54.666103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:54.674824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aba9abe8-2ca9-48ff-8722-b0252baef922 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.169496 Sep 13 20:06:54.675426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1288/2580] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:54 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:55.698561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:55.699167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:55.705872 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:55.706353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:55.706780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:55.707466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:55.707910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:55.708324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:55.848610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:55.857253 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-721720db-5f81-4600-958a-98185304631d tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162528 Sep 13 20:06:55.857965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1293/2581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:55 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:56.880283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:56.880884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:56.887983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:56.888454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:56.888881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:56.889549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:56.890012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:56.890427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:57.033641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:57.042093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0c68e05b-7283-42ca-bf5a-0ccd82907e5e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.165647 Sep 13 20:06:57.042689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1289/2582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:56 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:58.065455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:58.066052 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:58.072393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:58.072868 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:58.073296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:58.074004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:58.074450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:58.074865 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:58.210894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:58.218737 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fd59ee95-ae71-4c6b-a0e2-6cc0d78d3a71 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.157166 Sep 13 20:06:58.219297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1294/2583] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:58 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:06:59.243064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:06:59.243677 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:06:59.250164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:59.250652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:59.251086 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:59.251766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:06:59.252217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:06:59.252641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:06:59.383927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:06:59.391927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-272a153b-e9cf-4b53-aee6-7679f3dcf649 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.153313 Sep 13 20:06:59.392508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1290/2584] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:06:59 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:00.415535 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:00.416157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:00.423314 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:00.423800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:00.424244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:00.424923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:00.425372 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:00.425842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:00.559808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:00.567588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2e0734cb-3aa1-4fd9-a5dc-bfc2c300f4fb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.156459 Sep 13 20:07:00.568150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1295/2585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:00 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:01.591251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:01.591909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:01.598798 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:01.599284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:01.599718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:01.600921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:01.601364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:01.601817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:01.737293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:01.745915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-139e55dd-0f8d-4dcb-ae09-1fa4f57335eb tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.158520 Sep 13 20:07:01.746499 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1291/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:01 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:02.768408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:02.769045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:02.776351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:02.776828 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:02.777257 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:02.777963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:02.778410 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:02.778830 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:02.781502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=80 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:02.917437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:02.925285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1f3995f1-b448-4bca-95f0-d7bb76af9e14 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.160705 Sep 13 20:07:02.925898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1296/2587] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:02 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:03.165723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:03.166340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:03.172708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.173189 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.173640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.174329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.174776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.175196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.358360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:07:03.437852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-306880dc-2650-448f-8cee-7cfaf899b2e4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 204 len: 0 microversion: 2.1 time: 0.276466 Sep 13 20:07:03.438456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1292/2588] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:07:03 2022] DELETE /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:07:03.448424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:03.449224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:03.455479 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.455956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.456391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.457075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.457525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.458003 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.591067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:03.604978 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7d163504-7a87-420d-82f3-c85962b79273 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1735 microversion: 2.1 time: 0.161916 Sep 13 20:07:03.605556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1297/2589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:03.949111 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:03.949833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:03.955721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.956201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.956639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:03.957322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:03.957826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:03.958252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:04.180355 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:04.188085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6bcdcb41-6a92-4dbd-8754-edb06b2b1d95 tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.243213 Sep 13 20:07:04.188646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1293/2590] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:03 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:04.628809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:04.629637 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:04.641445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:04.642209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:04.642765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:04.643555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:04.644007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:04.644613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:04.742451 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:04.751667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-55d057b6-a159-4f50-b99e-0937b8941d99 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1667 microversion: 2.1 time: 0.127156 Sep 13 20:07:04.752250 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1298/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1667 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:05.063708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-4226fbc2-a21c-420f-b960-a4eb7d194cbe req-e69f8160-a452-4955-ad9e-df2cf9dc294e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10efef25-2b14-468a-9a72-0e6412d56a07", "name": "network-vif-deleted", "tag": "c9a1dd24-315a-4d83-b7ac-808bb7dd7e38"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:07:05.076018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-4226fbc2-a21c-420f-b960-a4eb7d194cbe req-e69f8160-a452-4955-ad9e-df2cf9dc294e service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.076491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-4226fbc2-a21c-420f-b960-a4eb7d194cbe req-e69f8160-a452-4955-ad9e-df2cf9dc294e service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.077130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-4226fbc2-a21c-420f-b960-a4eb7d194cbe req-e69f8160-a452-4955-ad9e-df2cf9dc294e service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.092865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-4226fbc2-a21c-420f-b960-a4eb7d194cbe req-e69f8160-a452-4955-ad9e-df2cf9dc294e service nova] Creating event network-vif-deleted:c9a1dd24-315a-4d83-b7ac-808bb7dd7e38 for instance 10efef25-2b14-468a-9a72-0e6412d56a07 on hv-cinder-82880 Sep 13 20:07:05.098807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-4226fbc2-a21c-420f-b960-a4eb7d194cbe req-e69f8160-a452-4955-ad9e-df2cf9dc294e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134035 Sep 13 20:07:05.099694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1294/2592] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:07:05.270607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:05.271225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:05.279313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.279803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.280240 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.280931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.281385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.281839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.430288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:05.438597 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-629c9574-82e5-443e-a644-83daf720084e tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.230700 Sep 13 20:07:05.439581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1299/2593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:05 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:05.776339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:05.777160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:05.784178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.784663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.785103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.785854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:05.786485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:05.786914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:05.789748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:05.852743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:05.861083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-369d8425-754b-4051-b2dd-625242774372 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.089307 Sep 13 20:07:05.861696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1295/2594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:06.464221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:06.464879 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:06.471237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:06.471710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:06.472138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:06.472815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:06.473256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:06.473693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:06.607686 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:06.615439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71ffa944-f953-4c25-b316-f12aba03aeae tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.155145 Sep 13 20:07:06.616010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1300/2595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:06 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:07:06.884280 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:06.884892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:06.891595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:06.892073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:06.892509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:06.893186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:06.893655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:06.894083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:06.955664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:06.964463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aaa221b0-53ec-49b4-a28d-e2d74c493065 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084540 Sep 13 20:07:06.965019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1296/2596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:07.638380 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:07.639192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:07.646051 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:07.646536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:07.647000 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:07.647964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:07.648675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:07.649281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:07.789307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:07.797025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0775db8b-3bae-4f51-8e41-41517e5304aa tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.162585 Sep 13 20:07:07.797592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1301/2597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:07 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:07.988113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:07.988687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:07.995814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:07.996299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:07.996732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:07.997416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:07.998082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:07.998507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:08.064624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:08.073708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b85a10a6-75d7-4186-a3f1-eccac9cc0652 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.090072 Sep 13 20:07:08.074283 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1297/2598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:08.821009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:08.821631 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] [instance: 11000afd-6551-4b16-81dd-f5905971fb0f] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:08.828139 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:08.828616 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:08.829045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:08.829754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:08.830203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:08.830624 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:08.960840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a2e785cf504586973630313c0b4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df360ab0b7594850b1e0b03b48e1f8ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:08.968573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-088b03bd-2014-4780-81bc-c521ec4de6db tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f" status: 200 len: 1448 microversion: 2.1 time: 0.152064 Sep 13 20:07:08.969136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1302/2599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:08 2022] GET /compute/v2.1/servers/11000afd-6551-4b16-81dd-f5905971fb0f => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:09.052487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e3f0ab96-7bff-4932-834d-a5210f7a985b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] Calling method '.version_select at 0x7f67651f6940>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:09.075029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e3f0ab96-7bff-4932-834d-a5210f7a985b tempest-TestShelveInstance-1631922453 tempest-TestShelveInstance-1631922453-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-111336902" status: 202 len: 0 microversion: 2.1 time: 0.026239 Sep 13 20:07:09.075549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1298/2600] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:07:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-111336902 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:07:09.096621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:09.097229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:09.103790 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:09.104279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:09.104711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:09.105394 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:09.105870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:09.106298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:09.170592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:09.179659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-47ea6d50-3f14-476d-8565-0b061d6e4930 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087310 Sep 13 20:07:09.180411 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1303/2601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:07:10.202814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:10.203797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:10.206789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:10.212865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:10.213375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:10.213834 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:10.214518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:10.215153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:10.215866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:10.292914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:10.305881 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-17df93d3-d8aa-45b6-9ff9-b5fae6afbdff tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.107320 Sep 13 20:07:10.306468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1299/2602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:11.331710 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:11.332799 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:11.341127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:11.341127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:11.342801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:11.343191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:11.343853 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:11.344391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:11.438099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:11.448839 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d18c4e4e-b2d1-4de6-a750-d0f66bed26ce tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.123153 Sep 13 20:07:11.459497 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1304/2603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:12.473897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:12.474483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:12.481057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:12.481472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:12.481935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:12.482611 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:12.483051 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:12.483466 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:12.545206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:12.554301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ca0932f1-109d-42ba-82d3-15b6951e3fc6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084198 Sep 13 20:07:12.554854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1300/2604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:13.578681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:13.579303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:13.581712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=36 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:13.587577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:13.588161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:13.588606 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:13.589692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:13.590203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:13.590627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:13.655335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:13.664264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a8f51c03-0234-49c9-9f45-1d0b2c25be4a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.090066 Sep 13 20:07:13.664827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1305/2605] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:14.688420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:14.689011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:14.695982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:14.696468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:14.697104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:14.697844 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:14.698286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:14.698698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:14.791717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:14.800422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dbce0d6f-35ec-4525-9dc4-d0ea2fb6aca0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.116102 Sep 13 20:07:14.801242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1301/2606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:14 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:07:15.824552 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:15.825315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:15.831684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:15.832173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:15.832608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:15.833298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:15.833784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:15.834206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:15.902807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:15.911286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-846c19fe-0c68-4feb-a3ca-7781382e8660 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.091940 Sep 13 20:07:15.912465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1306/2607] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:16.936991 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:16.937624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:16.944562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:16.945039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:16.945474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:16.946176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:16.946629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:16.947067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:17.007678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:17.016527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a6e68278-e454-46e8-ae92-bca69e526a6f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083213 Sep 13 20:07:17.020305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1302/2608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:18.039284 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:18.040251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:18.047715 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:18.048192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:18.048619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:18.049289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:18.049760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:18.050177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:18.113315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:18.121732 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a10cbcd5-94ff-419c-b3ca-a33d6b5f6b52 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086343 Sep 13 20:07:18.122312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1307/2609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:19.150758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:19.151387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:19.157974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:19.158461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:19.158889 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:19.159562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:19.160005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:19.160415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:19.225523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:19.234256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b9af0ed3-fdbf-4c8e-ab05-18e4a3c040be tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.088174 Sep 13 20:07:19.234829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1303/2610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:20.256800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:20.257433 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:20.263512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:20.263992 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:20.264424 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:20.265112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:20.265562 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:20.266012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:20.337116 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:20.348275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-08bfe9d6-e9a0-407b-93f8-685f36c6a043 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.095464 Sep 13 20:07:20.349511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1308/2611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:21.371768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:21.372378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:21.378963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:21.379445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:21.379874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:21.380574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:21.381003 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:21.381421 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:21.448575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:21.456863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-167d6901-4fd5-4b7a-8b6e-069386e7b84b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.089074 Sep 13 20:07:21.457451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1304/2612] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:07:22.481039 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:22.481749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:22.488262 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:22.488741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:22.489171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:22.489883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:22.490945 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:22.491495 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:22.560146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:22.568526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1e0f15a1-90a5-48fa-b922-fb6bbb44fb1e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.091152 Sep 13 20:07:22.569118 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1309/2613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:23.591286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:23.591903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:23.598335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:23.598815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:23.599382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:23.600078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:23.600519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:23.601230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:23.665152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:23.673399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5f5300a9-f90e-4a60-857d-62d3e167d9a0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086019 Sep 13 20:07:23.673983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1305/2614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:24.697151 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:24.697767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:24.704587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:24.705064 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:24.706474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:24.707144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:24.707588 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:24.708007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:24.771153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:24.779480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-da1649b4-b329-44fa-8ed4-44edf3f4d30b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087070 Sep 13 20:07:24.780047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1310/2615] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:25.803009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:25.803607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:25.809953 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:25.810431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:25.810859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:25.811527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:25.811968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:25.812382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:25.875751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:25.885849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c1a801e2-fa59-4078-bd28-b2a0e3562613 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087226 Sep 13 20:07:25.886407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1306/2616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:25 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:26.909556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:26.910174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:26.916546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:26.917027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:26.917459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:26.918161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:26.918613 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:26.919060 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:26.982297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:26.990402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e4fb698d-3294-4c7e-b6b7-2de9924a9caf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084699 Sep 13 20:07:26.991018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1311/2617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:28.014423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:28.015005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:28.021509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:28.023316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:28.023750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:28.024432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:28.024876 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:28.025292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:28.086125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:28.094128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a869590-f1bc-4dc0-9c5d-5ac40aca6cc8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084161 Sep 13 20:07:28.094678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1307/2618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:29.117099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:29.117726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:29.124393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:29.124871 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:29.125307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:29.126014 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:29.126474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:29.126897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:29.191126 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:29.193309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=100 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:29.201057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b8044bff-1a51-4406-a2aa-6964887d817e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087779 Sep 13 20:07:29.201656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1312/2619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:30.224632 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:30.225275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:30.232116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:30.233022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:30.233022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:30.233707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:30.234155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:30.234696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:30.297019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:30.305753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1e7ae580-92b6-4277-99f8-c38e47f59c74 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085072 Sep 13 20:07:30.306316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1308/2620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:31.328753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:31.329317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:31.336186 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:31.336668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:31.337101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:31.337829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:31.338278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:31.338698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:31.402390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:31.410692 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d92df47a-2b4e-4c00-95a8-cdc6bb458ef2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085917 Sep 13 20:07:31.411274 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1313/2621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:32.434277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:32.434886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:32.441336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:32.441849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:32.442286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:32.442968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:32.443414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:32.444343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:32.505162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:32.513977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-51a4192e-5fb4-41d4-8d16-82c30f97ce1b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083663 Sep 13 20:07:32.514534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1309/2622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:33.537276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:33.537907 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:33.544242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:33.544720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:33.545147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:33.545847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:33.546297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:33.546712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:33.608454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:33.618044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ec21e9ee-a69c-4f1e-b0c4-2de9983bf40a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084571 Sep 13 20:07:33.618621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1314/2623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:34.641572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:34.642534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:34.649336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:34.649855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:34.650295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:34.650989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:34.651440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:34.651866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:34.713523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:34.721868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5fffccbf-7b17-4214-88db-1fbe4dfb7398 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084209 Sep 13 20:07:34.722414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1310/2624] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:35.745413 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:35.746094 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:35.752582 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:35.753069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:35.753510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:35.754225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:35.754678 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:35.755110 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:35.827517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:35.836338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-639d480d-d9fa-471a-a26a-a1645c7bc032 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.095045 Sep 13 20:07:35.837171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1315/2625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:35 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:36.858918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:36.859504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:36.866448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:36.866939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:36.867373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:36.868061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:36.868511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:36.868938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:36.871549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=90 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:36.942222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:36.950378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-26ecdf50-6138-49b5-ba46-230f816e9a17 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.095443 Sep 13 20:07:36.950943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1311/2626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:07:37.973239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:37.973939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:37.981245 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:37.981867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:37.982291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:37.983043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:37.983490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:37.983906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:38.047742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:38.056279 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1d5c971d-ba7e-44f8-b890-16059030b68a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087151 Sep 13 20:07:38.056842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1316/2627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:39.078317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:39.078920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:39.086121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:39.086600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:39.087036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:39.087715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:39.088161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:39.088582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:39.148785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:39.157540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7e02e23c-ed73-4b77-8d84-28f1ba284621 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083005 Sep 13 20:07:39.158217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1312/2628] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:40.180317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:40.180917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:40.187431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:40.187906 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:40.188340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:40.189009 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:40.189450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:40.189888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:40.254544 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:40.264657 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-6deb43e0-e692-4804-b071-b423ea4cd399 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087818 Sep 13 20:07:40.265753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1317/2629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:41.289653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:41.290206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:41.292463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=28 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:41.297766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:41.298248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:41.298684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:41.299360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:41.299806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:41.300229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:41.360076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:41.370134 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-264a906c-7887-4e9f-ae1f-0fddb45d6945 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084904 Sep 13 20:07:41.370808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1313/2630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:42.392221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:42.392826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:42.400050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:42.400526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:42.400958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:42.401656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:42.402108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:42.402532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:42.463412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:42.471540 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-91fdcb0e-54be-4c62-82e1-b1ff1f31a7ae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083145 Sep 13 20:07:42.472108 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1318/2631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:43.495979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:43.496654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:43.503275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:43.503757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:43.504193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:43.504875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:43.505328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:43.505815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:43.567206 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:43.575411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f5e17d6d-94c0-41a4-94b3-48cbeb7b1e60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083289 Sep 13 20:07:43.575975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1314/2632] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:44.598042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:44.598635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:44.601239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=28 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:44.606649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:44.607138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:44.607575 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:44.608259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:44.608711 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:44.609138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:44.674024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:44.682660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-270c3f19-3eb9-451d-925f-0c7248674c53 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.088526 Sep 13 20:07:44.683225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1319/2633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:45.705946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:45.706543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:45.712821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:45.713310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:45.713756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:45.714427 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:45.714870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:45.715292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:45.777255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:45.785458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d487ce72-c0d5-4ad9-aa17-36acb354847f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083369 Sep 13 20:07:45.786045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1315/2634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:46.809309 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:46.809940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:46.812389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:07:46.812528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:07:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:07:46.818212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:46.818698 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:46.819137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:46.819824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:46.820281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:46.820709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:46.883054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:46.891206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-41f22246-eba8-4e49-85ae-351b40d9ffa9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085897 Sep 13 20:07:46.891808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1320/2635] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:46 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:47.915367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:47.915973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:47.922041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:47.922523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:47.922956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:47.923634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:47.924080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:47.924502 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:47.984398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:47.992458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5b004ce3-be5a-4a73-b869-902b6f3b75f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.081862 Sep 13 20:07:47.993019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1316/2636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:49.016423 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:49.017036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:49.026987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:49.027477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:49.027914 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:49.028608 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:49.029062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:49.030667 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:49.093714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:49.102693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-779da8df-768c-429f-9738-909908b34146 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.090801 Sep 13 20:07:49.103261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1321/2637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:50.125254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:50.125867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:50.132309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:50.132794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:50.133226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:50.133937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:50.134387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:50.134809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:50.195973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:50.205256 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5ddf49e2-4d11-47bc-92de-ed643e9694e7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083946 Sep 13 20:07:50.205854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1317/2638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:51.228113 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:51.228682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:51.235190 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:51.235668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:51.236095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:51.236774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:51.237219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:51.237649 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:51.301697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:51.310427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-7578c85e-325c-4b96-a465-0229e33a9df1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086314 Sep 13 20:07:51.311002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1322/2639] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:52.334701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:52.335338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:52.342525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:52.343015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:52.343452 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:52.344156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:52.344607 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:52.345047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:52.409986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:52.418984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-17eacf2c-9c10-47f4-b682-f9f890eab6d9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.088825 Sep 13 20:07:52.419564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1318/2640] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:53.442849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:53.444112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:53.450396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:53.450887 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:53.451315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:53.451994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:53.452438 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:53.452857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:53.516425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:53.525125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0621add2-8c5d-4541-b33d-42ea4e922d9a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086874 Sep 13 20:07:53.525707 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1323/2641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:54.548741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:54.549364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:54.555827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:54.556310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:54.556733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:54.557415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:54.557885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:54.558302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:54.620239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:54.629634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fda6379a-bc8f-4ea2-b5c0-35fd0b214bf1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085379 Sep 13 20:07:54.630162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1319/2642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:55.653509 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:55.654609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:55.665409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:55.665944 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:55.666387 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:55.667085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:55.667537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:55.667959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:55.730308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:55.738456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ac68a28c-3135-4f11-8fa9-349ceec70585 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.089116 Sep 13 20:07:55.739028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1324/2643] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:56.761266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:56.761863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:56.768072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:56.768540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:56.768968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:56.769660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:56.770103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:56.770531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:56.831656 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:56.840749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e6a288f3-b6e8-444e-92ab-5d2e38c7a4da tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083538 Sep 13 20:07:56.841215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1320/2644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:57.864756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:57.865981 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:57.872675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:57.873156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:57.873595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:57.874323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:57.874777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:57.875203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:57.944998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:57.953242 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-94db7baa-f29f-4dd0-8035-f90b0f68dadc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.092460 Sep 13 20:07:57.953838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1325/2645] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:57 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:07:58.979351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:07:58.979948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:07:58.986536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:58.987028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:58.987464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:58.988155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:07:58.988606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:07:58.989030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:07:59.058931 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:07:59.067472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1d2b2d4b-22e2-4b1c-ad01-e3f6cf66804d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.091983 Sep 13 20:07:59.068802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1321/2646] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:07:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:00.091227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:00.091829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:00.098256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:00.098740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:00.099908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:00.100619 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:00.101123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:00.101555 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:00.104443 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=80 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:00.165189 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:00.173714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0bcf48f6-7436-4512-afd9-0eaf03baa2bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086355 Sep 13 20:08:00.174280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1326/2647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:01.196311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:01.196915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:01.203485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.203979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.204396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.205075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.205517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.205956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.269567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:01.278155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c3a18b3b-e48a-41d3-9997-5072e0eea6a3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086175 Sep 13 20:08:01.278652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1322/2648] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:01.915091 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:01.915685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:01.922824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.923306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.923730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.924425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.924862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.925282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.932385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:01.932934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:01.938983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.939465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.939898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.940582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:01.941028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:01.941451 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:01.951645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:08:01.971468 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:08:02.042561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29d7e643-2f34-4bba-a88c-ccc812cb549a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 204 len: 0 microversion: 2.1 time: 0.128773 Sep 13 20:08:02.043188 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1327/2649] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:08:01 2022] DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 20:08:02.048988 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:02.049706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:02.056682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.057210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.057968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.058730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.059184 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.059607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.070757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-07e0cda0-9e22-456b-95f7-d9f3dccfb173 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 204 len: 0 microversion: 2.20 time: 0.141954 Sep 13 20:08:02.071350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1323/2650] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 13 20:08:01 2022] DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 20:08:02.076872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:02.077740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:02.083785 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.084266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.084694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.085380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.085848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.086266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.241771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:02.250141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5ec207d0-1daa-41e7-bd3d-db6b1af424fa tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1676 microversion: 2.1 time: 0.177581 Sep 13 20:08:02.250729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1324/2651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:02 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:02.255997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:02.256602 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:02.262893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.263372 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.263833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.264520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.264965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.265385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.402679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:02.410862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:02.412294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:02.413435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-921b25ca-d1c3-4b08-b8f6-881d1cf1853c tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1722 microversion: 2.20 time: 0.161721 Sep 13 20:08:02.414018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1325/2652] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 20:08:02 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:08:02.418642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:02.419239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:02.425348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.425800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.426231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.427001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:02.427358 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:02.427774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:02.430738 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:02.499700 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:02.508475 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2b662ef3-d0e3-4130-89c9-2966eeb8aa8f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.093458 Sep 13 20:08:02.509052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1326/2653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:03.276180 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:03.277323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:03.284545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.285114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.285696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.286462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.287089 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.287573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.363975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15069aa932aa473983c4102961b855d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2981eddb8742492fac516851f761e2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:03.388930 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a93812b8-782b-41b1-82f3-f8717c08abb4 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 200 len: 1608 microversion: 2.1 time: 0.116193 Sep 13 20:08:03.391043 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1327/2654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:03 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 1608 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:03.422879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-6712bb93-b945-4188-a316-484967a97390 req-ade8fa96-036f-4787-8051-f3410570bfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9496396-f352-4a04-8d1d-f677e8315b96", "name": "network-vif-deleted", "tag": "874a4f76-0f06-4864-a118-ae7e88a0170c"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:08:03.441631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-6712bb93-b945-4188-a316-484967a97390 req-ade8fa96-036f-4787-8051-f3410570bfea service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.448618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-6712bb93-b945-4188-a316-484967a97390 req-ade8fa96-036f-4787-8051-f3410570bfea service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.449634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-6712bb93-b945-4188-a316-484967a97390 req-ade8fa96-036f-4787-8051-f3410570bfea service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.480828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-6712bb93-b945-4188-a316-484967a97390 req-ade8fa96-036f-4787-8051-f3410570bfea service nova] Creating event network-vif-deleted:874a4f76-0f06-4864-a118-ae7e88a0170c for instance f9496396-f352-4a04-8d1d-f677e8315b96 on hv-cinder-82880 Sep 13 20:08:03.492397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-6712bb93-b945-4188-a316-484967a97390 req-ade8fa96-036f-4787-8051-f3410570bfea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073546 Sep 13 20:08:03.494558 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1328/2655] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:08:03.501771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:03.503124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:03.512030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.512539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.512984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.513750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.514221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.514678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.691153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:03.715308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:03.720545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:03.721805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-04157b96-d61c-429e-b0b7-d2b201e4ff41 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1654 microversion: 2.20 time: 0.225614 Sep 13 20:08:03.727840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1329/2656] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 20:08:03 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1654 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 20:08:03.748948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:03.754281 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:03.777467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.778224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.778669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.779403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:03.779865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:03.780337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:03.888265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:03.899063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b9db63cc-2973-48e5-bd0a-6f10611d9aae tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.165838 Sep 13 20:08:03.900771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1330/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:03 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:03.997166 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-b4eb77d1-26dd-47c7-ae37-b119493a06ea req-72a20d25-b055-400b-8e9d-da8def991d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0d01e4-a3dc-4f0e-91fe-19875dca7be4", "name": "network-vif-deleted", "tag": "5f4800b1-c512-43ec-81b8-f2fd3dc5bd44"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:08:04.008106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-b4eb77d1-26dd-47c7-ae37-b119493a06ea req-72a20d25-b055-400b-8e9d-da8def991d74 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.008596 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-b4eb77d1-26dd-47c7-ae37-b119493a06ea req-72a20d25-b055-400b-8e9d-da8def991d74 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.009221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-b4eb77d1-26dd-47c7-ae37-b119493a06ea req-72a20d25-b055-400b-8e9d-da8def991d74 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.027815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-b4eb77d1-26dd-47c7-ae37-b119493a06ea req-72a20d25-b055-400b-8e9d-da8def991d74 service nova] Creating event network-vif-deleted:5f4800b1-c512-43ec-81b8-f2fd3dc5bd44 for instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 on hv-cinder-82880 Sep 13 20:08:04.033031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-b4eb77d1-26dd-47c7-ae37-b119493a06ea req-72a20d25-b055-400b-8e9d-da8def991d74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130948 Sep 13 20:08:04.041518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1331/2658] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:08:04.413457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:04.415620 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:04.423789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.424314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.425308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.427218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.427895 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.428496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.449868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 HTTP/1.1 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:08:04.451926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:08:04.454470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'f9496396-f352-4a04-8d1d-f677e8315b96'} Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:08:04.455902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:08:04.457563 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:04.461151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:08:04.462263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dc7cf91f-45b7-4cc3-861a-892f8bb1dcf7 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 404 len: 111 microversion: 2.1 time: 0.054312 Sep 13 20:08:04.463144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1332/2659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:04 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:08:04.473161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dce542de-0659-4c5d-adeb-0d9a0b5f9ade tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '.version_select at 0x7f676557a430>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:04.506886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dce542de-0659-4c5d-adeb-0d9a0b5f9ade tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482795750" status: 202 len: 0 microversion: 2.1 time: 0.039323 Sep 13 20:08:04.507465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1333/2660] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Sep 13 20:08:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1482795750 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:08:04.756098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:04.756719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:04.764109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.764824 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.765444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.766346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.767520 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.768183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.815680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.816169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.816833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.817302 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lazy-loading 'fault' on Instance uuid 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:08:04.871539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:04.880852 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:04.882913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3177776f47ef4d3e937c2e8efb360e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03c01ff6ef24c59b65362c66ad1a1ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:04.884371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-37fc1db2-6f33-451a-aa00-6eb88268e29d tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 200 len: 1371 microversion: 2.20 time: 0.132517 Sep 13 20:08:04.885521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1334/2661] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 20:08:04 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 20:08:04.928542 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:04.929485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:04.938561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.939463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.940158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:04.941381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:04.942231 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:04.942919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:05.078012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:05.095477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d4039f1a-8f34-4737-9641-f7e6238b26cd tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.172390 Sep 13 20:08:05.102287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1335/2662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:05.910932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:05.912211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:05.918692 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:05.919172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:05.919606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:05.920284 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:05.920723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:05.921137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:05.935032 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 HTTP/1.1 Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:08:05.936616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:08:05.938375 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '1e0d01e4-a3dc-4f0e-91fe-19875dca7be4'} Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:08:05.939337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:08:05.940915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:08:05.943057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:08:05.943057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d4fe5574-8405-4ce8-8d6c-051f83e91bfd tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 404 len: 111 microversion: 2.20 time: 0.031028 Sep 13 20:08:05.943057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1336/2663] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 20:08:05 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 20:08:05.947480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5f0cfc2c-6126-4f62-85a7-b99ae849f1b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '.version_select at 0x7f67654a31f0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:05.967389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5f0cfc2c-6126-4f62-85a7-b99ae849f1b0 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371436922" status: 204 len: 0 microversion: 2.20 time: 0.023630 Sep 13 20:08:05.967966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1337/2664] 10.222.0.23 () {60 vars in 1262 bytes} [Tue Sep 13 20:08:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371436922 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 20:08:06.125011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:06.125732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:06.136143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:06.136143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:06.136980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:06.137733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:06.138571 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:06.138703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:06.238961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:06.247318 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5e2689e1-36d0-4b82-a250-c65fc8b4d0bc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.126459 Sep 13 20:08:06.247890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1338/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:06 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:07.270753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:07.271685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:07.278028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:07.278503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:07.278935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:07.279621 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:07.280063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:07.280481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:07.344610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:07.352944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ab3bfb83-3338-4da2-9bc3-ce2f84901a28 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086110 Sep 13 20:08:07.353508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1339/2666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:07 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:08.376438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:08.377150 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:08.384052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:08.384534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:08.384971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:08.385717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:08.386136 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:08.386556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:08.449221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:08.457531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a34503e9-1f12-498b-8915-a66fd0a5ca50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084903 Sep 13 20:08:08.458128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1340/2667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:08 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:09.481373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:09.482095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:09.488507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:09.488988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:09.489417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:09.490131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:09.490570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:09.490986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:09.552275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:09.560461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a44ce8a6-7230-48f6-bb2a-0692f3cf4c97 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.082949 Sep 13 20:08:09.561025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1341/2668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:09 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:10.583074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:10.583774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:10.590262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:10.590743 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:10.591175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:10.591870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:10.592313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:10.592733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:10.657867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:10.666490 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b42d26ef-bfa9-4885-a386-6c0f27a015f7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087305 Sep 13 20:08:10.667030 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1342/2669] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:10 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:11.689838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:11.690503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:11.693635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:11.699365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:11.699857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:11.700296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:11.700993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:11.701445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:11.701899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:11.767786 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:11.776292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8beac2e5-ae3a-4254-9863-731025335ba2 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.090444 Sep 13 20:08:11.776948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1343/2670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:11 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:12.054673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:12.081212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:12.799131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:12.799802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:12.806295 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:12.806772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:12.807269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:12.807942 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:12.808386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:12.808805 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:12.870589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:12.878833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e7ce8feb-1308-44f3-bb08-27f0b3a6cecf tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083510 Sep 13 20:08:12.879390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1344/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:12 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:13.902315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:13.902988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:13.909369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:13.909879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:13.910314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:13.910990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:13.911491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:13.911911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:13.975885 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:13.984250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8d6f9aca-3eb2-45a5-852d-f935281ef1fc tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085758 Sep 13 20:08:13.984815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1345/2672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:13 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:15.008498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:15.009183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:15.015790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:15.016277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:15.016718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:15.017412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:15.017893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:15.018311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:15.080697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:15.089556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-892550da-b6b1-4f5c-9ace-46212e33295e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085506 Sep 13 20:08:15.090157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1346/2673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:15 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:16.112750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:16.113556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:16.120163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:16.120686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:16.121085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:16.121903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:16.122314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:16.122736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:16.125500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:16.194914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:16.203511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cf5a5915-d85d-413d-98f2-a9ce029371d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.094872 Sep 13 20:08:16.204048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1347/2674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:16 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:17.228221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:17.228962 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:17.235270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:17.235760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:17.236188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:17.236879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:17.237322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:17.237773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:17.303725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:17.312299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e7223fb6-06c9-4ecb-b009-e593ff5b726c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.088445 Sep 13 20:08:17.312879 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1348/2675] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:17 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:18.336008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:18.336669 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:18.343135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:18.343594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:18.344031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:18.344711 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:18.345154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:18.345569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:18.409278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:18.418286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-95512131-a646-4844-82ae-7bffd7adc8ea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086231 Sep 13 20:08:18.418859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1349/2676] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:18 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:19.444723 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:19.445416 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:19.451884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:19.452368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:19.452804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:19.453495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:19.453980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:19.454401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:19.517633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:19.526465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-34e31e03-371b-4d94-a275-e3a2595dfbd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086071 Sep 13 20:08:19.527020 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1350/2677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:19 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:20.549128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:20.549878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:20.556292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:20.556799 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:20.557230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:20.557945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:20.558392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:20.558814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:20.625442 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:20.633767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e1e468fd-b777-4bb1-880d-3a4c32a29a7f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.088433 Sep 13 20:08:20.634878 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1351/2678] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:20 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:21.657626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:21.658350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:21.665316 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:21.666126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:21.666268 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:21.666850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:21.667293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:21.667708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:21.729294 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:21.737559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-18ac86dd-5b3c-4354-b48f-8170c9f10992 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083816 Sep 13 20:08:21.738146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1352/2679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:21 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:22.760828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:22.761430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:22.767762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:22.768237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:22.768673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:22.769346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:22.769828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:22.770247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:22.835151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:22.843225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9fd1c9e8-85dc-47d7-92d8-c26b73072cb8 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086245 Sep 13 20:08:22.843791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1353/2680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:22 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:23.866537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:23.867240 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:23.873592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:23.874097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:23.874525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:23.875198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:23.875640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:23.876055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:23.937173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:23.945504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-69796fd4-b753-445e-8d79-5bbf5411871a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083349 Sep 13 20:08:23.946106 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1354/2681] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:23 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:24.968579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:24.969307 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:24.975544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:24.976025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:24.976455 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:24.977124 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:24.977814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:24.978056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:25.041770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:25.049995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c42316d5-de24-4c75-aa17-0e4344ffabd6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085263 Sep 13 20:08:25.050555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1355/2682] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:24 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:26.073341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:26.074056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:26.080467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:26.080945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:26.081379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:26.082084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:26.082534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:26.083458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:26.148018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:26.156140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-fb4b7d13-1bbc-465f-9d74-6837e3eb949a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086775 Sep 13 20:08:26.156701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1356/2683] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:26 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:27.179521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:27.180212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:27.186652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:27.187123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:27.187551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:27.188225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:27.188666 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:27.189079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:27.249729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:27.257848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-04bd2a17-326a-4f95-b1ed-8816e6a0fe01 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.082921 Sep 13 20:08:27.258403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1357/2684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:27 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:28.281519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:28.282221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:28.288432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:28.288918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:28.289366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:28.290201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:28.290555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:28.290995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:28.351903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:28.360063 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ac7a6d8d-c296-498e-b8c6-04d3a5afe874 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.082590 Sep 13 20:08:28.360661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1358/2685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:28 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:29.384264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:29.384990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:29.391886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:29.392360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:29.392788 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:29.393456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:29.393926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:29.394340 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:29.461319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:29.470543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-94a6b65b-c2de-48f1-af55-0602bf387644 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.090600 Sep 13 20:08:29.471123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1359/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:29 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:30.493101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:30.493821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:30.500081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:30.500554 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:30.500981 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:30.501675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:30.502119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:30.502533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:30.563359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:30.571543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8865d610-18d1-44b7-b2c1-7c09bbb8b90a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.082285 Sep 13 20:08:30.572093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1360/2687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:30 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:31.594674 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:31.595357 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:31.603135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:31.603135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:31.603504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:31.604116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:31.604556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:31.604972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:31.667751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:31.675753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d4026f82-8969-4085-be63-7f4827df2588 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084948 Sep 13 20:08:31.676310 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1361/2688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:31 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:32.699548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:32.700250 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:32.706555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:32.707029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:32.707456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:32.708158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:32.708600 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:32.709018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:32.768819 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:32.777342 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0ef0e497-fb02-4ec9-92c4-d0bed848f30c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.081622 Sep 13 20:08:32.777938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1362/2689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:32 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:33.800345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:33.801018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:33.807379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:33.807849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:33.808278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:33.808950 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:33.809418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:33.809859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:33.875415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:33.877569 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:33.885149 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f26d9f99-b1b6-4251-8f30-266aaefe9c73 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.088657 Sep 13 20:08:33.885729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1363/2690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:33 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:34.908549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:34.909258 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:34.916143 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:34.916624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:34.917058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:34.917772 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:34.918215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:34.918634 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:34.979404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:34.987505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-30804b74-b8dc-4e2c-8ab2-aa534418641e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083122 Sep 13 20:08:34.988059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1364/2691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:34 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:36.011112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:36.011817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:36.018325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:36.018810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:36.019253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:36.020617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:36.020726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:36.021090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:36.082822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:36.091568 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d2b406be-dce1-4bda-aa89-d387bde75a39 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084407 Sep 13 20:08:36.092138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1365/2692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:36 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:37.115361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:37.116073 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:37.122354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:37.122833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:37.123264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:37.123940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:37.124386 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:37.124808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:37.187644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:37.196449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b6903016-b118-4119-ac00-e6ea38ea30c9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085431 Sep 13 20:08:37.197019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1366/2693] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:37 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:38.219464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:38.220088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:38.226429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:38.226909 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:38.227338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:38.228005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:38.228446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:38.228861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:38.294265 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:38.302545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b5a8e7ac-90a1-4ce6-9fd9-62b7b15b0c49 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086981 Sep 13 20:08:38.303153 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1367/2694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:38 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:39.326158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:39.326823 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:39.333628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:39.334120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:39.334550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:39.335224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:39.335663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:39.336081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:39.397531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:39.405719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-01a403c3-48a5-43e6-8fd0-cc25fbfb8bea tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083567 Sep 13 20:08:39.406278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1368/2695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:39 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:08:40.429013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:40.429774 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:40.436009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:40.436482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:40.436912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:40.437593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:40.438075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:40.438778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:40.501913 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:40.510121 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-94a9dfae-01a0-4fc6-a706-4f241e7a3f55 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085606 Sep 13 20:08:40.510679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1369/2696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:40 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:41.532810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:41.533519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:41.539796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:41.540278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:41.540716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:41.541403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:41.541884 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:41.542306 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:41.606840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:41.615587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e9cffcce-e5d7-4b57-ac98-32e3492e7610 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086652 Sep 13 20:08:41.616152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1370/2697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:41 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:42.638848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:42.639557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:42.641728 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=56 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:42.647815 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:42.648289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:42.648716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:42.649387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:42.649925 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:42.650349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:42.714218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:42.722422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-68db4d40-43e5-462a-ad2a-ada3e00d9cb3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087475 Sep 13 20:08:42.722997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1371/2698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:42 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:43.745907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:43.746521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:43.752828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:43.753305 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:43.753791 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:43.754472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:43.754922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:43.755348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:43.816681 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:43.825035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bec35a3b-3148-4c81-8e15-e7246f24917b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083113 Sep 13 20:08:43.825617 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1372/2699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:43 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:44.848264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:44.848997 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:44.855378 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:44.855851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:44.856285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:44.856961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:44.857406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:44.857858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:44.919806 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:44.928797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ed4e3b8-88ea-42a3-9147-76504563b1fb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084374 Sep 13 20:08:44.929356 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1373/2700] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:44 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:45.951505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:45.952201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:45.959269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:45.959747 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:45.960176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:45.960850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:45.961293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:45.961733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:46.022803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:46.030937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c96ecf99-53f6-49dd-b0c1-545a001acec9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083286 Sep 13 20:08:46.031496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1374/2701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:45 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:47.054023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:47.054679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:47.060509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:47.060988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:47.061424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:47.062130 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:47.062580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:47.063000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:47.126354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:47.135045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-527ef312-1fc6-4892-bc45-3c61a63e6a93 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085088 Sep 13 20:08:47.135638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1375/2702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:47 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:48.157402 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:48.158201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:48.164989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:48.165496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:48.165961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:48.166640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:48.167087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:48.167512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:48.230623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:48.240002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f1e6d6f7-47e3-417b-a62e-1fb8fcd27ee5 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086191 Sep 13 20:08:48.241035 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1376/2703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:48 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:49.263083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:49.263736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:49.270398 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:49.270867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:49.271343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:49.271963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:49.272410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:49.272827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:49.335906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:49.346807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3d84b1f5-2697-424d-8e3a-869b82be6ffb tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087523 Sep 13 20:08:49.347698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1377/2704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:49 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:50.369675 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:50.370345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:50.376586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:50.377059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:50.377485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:50.378188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:50.378647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:50.379557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:50.440062 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:50.448864 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ecdfe9d4-6d98-457d-b1db-bb75c5f36bf0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083127 Sep 13 20:08:50.449432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1378/2705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:50 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:51.471954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:51.473222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:51.479842 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:51.480325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:51.480755 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:51.481430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:51.481912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:51.482329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:51.546159 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:51.554890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e3ba17aa-13f4-4c5d-931f-9db8df22820a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086773 Sep 13 20:08:51.555467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1379/2706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:51 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:52.577438 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:52.578138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:52.584292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:52.584765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:52.585193 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:52.585890 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:52.586339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:52.586751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:52.601752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=100 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:52.652625 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:52.661401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-778f79ad-4524-4816-8abf-0833beadc8d7 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.087997 Sep 13 20:08:52.662052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1380/2707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:52 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:53.684385 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:53.685079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:53.692115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:53.692595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:53.693031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:53.693737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:53.694186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:53.694609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:53.755418 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:53.763635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c9afcfdb-d273-4bf6-8389-68436b18ce6a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083207 Sep 13 20:08:53.764194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1381/2708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:53 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:54.786627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:54.787271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:54.793630 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:54.794114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:54.794546 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:54.795225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:54.795672 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:54.796101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:54.859252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:54.867491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-57b42b5a-13e5-46ae-a188-f3540f9cc059 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.084768 Sep 13 20:08:54.868058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1382/2709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:54 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:55.890098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:55.890803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:55.897999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:55.898484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:55.898923 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:55.899608 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:55.900059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:55.900483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:55.964476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:55.973330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7dc3816f-6249-4b74-ac7f-f64c9a697576 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086424 Sep 13 20:08:55.973939 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1383/2710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:55 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:56.995408 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:56.996104 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:57.002415 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:57.002894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:57.003328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:57.004531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:57.004983 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:57.005404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:57.067370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:57.075345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-49ea5cdc-6b81-4c53-958b-7ba36e20e245 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.083874 Sep 13 20:08:57.075903 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1384/2711] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:56 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:58.098817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:58.099414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:58.105865 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:58.106351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:58.106793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:58.107482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:58.107934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:58.108359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:58.227061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:58.234457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e53d4e2a-a37d-4298-a210-3d45e1be261b tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.139441 Sep 13 20:08:58.235481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1385/2712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:08:59.258855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:08:59.259531 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:08:59.266122 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:59.266538 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:59.266965 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:59.267628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:08:59.268070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:08:59.268484 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:08:59.330959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:08:59.340652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2e0cdf9e-dfe4-4c60-9234-4b65fb1b8b5c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085699 Sep 13 20:08:59.341212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1386/2713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:08:59 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:09:00.363500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:00.364183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:00.370549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:00.371027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:00.371457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:00.372132 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:00.372574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:00.372990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:00.437516 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:00.445751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ca61b99-c589-4aa6-95fa-0d51e2a3fe3d tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.086105 Sep 13 20:09:00.446322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1387/2714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:00 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:09:01.468338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:01.469013 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:01.475888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:01.476366 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:01.476800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:01.477476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:01.477948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:01.478369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:01.542647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:09:01.554473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2bc7a049-b033-468f-adf6-5d2a16af8092 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.089099 Sep 13 20:09:01.555330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1388/2715] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:09:01 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:09:01.992977 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:09:01.993379 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:09:02.000980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:02.001467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:02.001924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:02.002623 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:09:02.003103 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:09:02.003526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:09:09.123611 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:09:09.124232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:09:11.999081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=37 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:12.026107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=55 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:23.502270 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:09:23.503010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:09:24.603847 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:09:24.604529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:11:01.953788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:11:02.208243 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:11:06.830191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:11:06.830840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:11:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:11:11.958063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:12.212615 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:12.342912 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:11:12.343199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:11:16.769201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:11:16.769839 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:12:29.135002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:12:29.135523 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:12:43.514618 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:12:43.515219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:12:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:12:44.612752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:12:44.613302 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:13:02.284061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 202 len: 0 microversion: 2.1 time: 300.239486 Sep 13 20:13:02.284758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:13:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:13:02.284758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:13:02 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:13:02.285344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-4e49b026-50c1-4dc1-ae28-ffa8df63a078 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:13:02.285344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:13:02.285344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:13:02.285687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1328/2716] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:08:02 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 300242 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:13:02.345725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:13:02.349173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:13:02.350797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:13:02.351927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:13:02.353155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:13:02.355014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:13:02.357110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) Sep 13 20:13:02.359696 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:13:02.362151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2670f399-a13b-402a-99f6-4dcfa0158a67) {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:13:02.362151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3b9833f5-83e8-4d27-8374-fd06d2ff0f7a tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 240.369116 Sep 13 20:13:02.362151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1389/2717] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:09:01 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 269 bytes in 240370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 20:13:02.363775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:02.367732 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:02.371490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:02.371958 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.372389 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:02.372534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.372862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.373547 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.374019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.374633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.378901 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.379373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.379809 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.380487 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.380936 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.381351 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.450515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:02.462301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2dfdb02e-df33-4960-ad58-4dff8ff2bfb6 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.175682 Sep 13 20:13:02.462886 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1329/2718] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:02.470728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:02.471327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:02.479180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.479697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.480123 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.481333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.481466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.482970 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.555641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:13:02.566931 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ab2ae262-1ff0-43a4-9bc6-2a5165d75f24 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.101420 Sep 13 20:13:02.568607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1330/2719] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:13:02 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:13:02.572105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:13:02.572801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:13:02.580537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.581068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.581436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:02.582173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:13:02.582620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:13:02.583032 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:13:03.882173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:13:03.929702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:13:12.371370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:12.579644 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:13.888458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=8 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:13.934854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:32.352461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:14:32.352979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:14:36.778739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:14:36.779376 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:15:04.255914 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:15:04.258396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:15:04.260179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:15:04.261543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:15:04.263362 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.264866 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:15:04.267679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) Sep 13 20:15:04.269172 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-74432d6e-7994-403a-bcdf-9fd124bb565a) {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 121.900530 Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:15:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:15:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-dee24616-41a6-41d2-b8f7-e97ea92839a0 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:15:04.270665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:15:04.271397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1390/2720] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:13:02 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 121902 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:15:04.271397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.271397 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.273775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.274264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.274701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.275381 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.277836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.277836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.295180 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:15:04.297348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:15:04.301002 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:15:04.304751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:15:04.307475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.310866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:15:04.313285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) Sep 13 20:15:04.317831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:15:04.320827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66d6bd67-5e57-47b1-af8c-fd682c7dc86f) {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:15:04.320827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a9e494a5-fafc-4e1a-8bfd-0ff69e952d47 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 121.730377 Sep 13 20:15:04.320827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1331/2721] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:13:02 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 269 bytes in 121732 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:15:04.320827 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.321696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.321696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.321696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.321696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.322431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.322431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.322431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.342462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:15:04.343107 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:04.351545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d653de39-6906-4bd1-8f63-707e716602f1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.089295 Sep 13 20:15:04.352548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1391/2722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:04.357951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.358364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.364244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.364724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.365350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.366080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.366647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.367072 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.424307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1324cac0-77d2-4e89-a4d7-e3854d9bed8a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.123121 Sep 13 20:15:04.424996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1332/2723] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:15:04 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:15:04.431765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.432455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.438517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.438991 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.439419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.440090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.440538 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.440955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.502955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:15:04.511850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-bfaae58c-a9c6-456d-a611-7aa56b7b813a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.085657 Sep 13 20:15:04.512406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1333/2724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:15:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:15:04.516696 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.517185 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.522573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.523062 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.523492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.524173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.524622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.525047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.549259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:15:04.595568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.compute.api [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:15:04.596365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0221262a-0a56-43d7-bb91-122150085f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.083054 Sep 13 20:15:04.596910 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1334/2725] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:15:04 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:15:04.601419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:15:04.601942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:15:04.607268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.607756 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.608191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:04.608867 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:15:04.609321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:15:04.609784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:15:14.362147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:14.385556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=10 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:14.605591 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:14.626742 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:49.144762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:15:49.145326 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:16:03.525236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:16:03.525902 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:16:04.622105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:16:04.622633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:16:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:17:04.575992 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:17:04.667934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:17:14.580454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:14.671844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:17:46.844407 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:17:46.845141 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:17:52.364580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:17:52.365120 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:17:56.788409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:17:56.789080 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:17:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:19:04.901330 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:19:04.903545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:19:04.905391 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:19:04.906994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:19:04.908331 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.909703 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:19:04.913575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) Sep 13 20:19:04.915109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f8bd1b6c-3011-42fd-9680-7f95e00c5b34) {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 240.551415 Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-0253f766-de6e-4c7e-b207-2a332cb52959 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:19:04.916337 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:19:04.916918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1392/2726] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:15:04 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 240554 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:04.916918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:04.916918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:04.919726 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:04.920219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:04.920655 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:04.921349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:04.921846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:04.922271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:04.940841 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:19:04.944289 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:19:04.949578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:19:04.951373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:19:04.954107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.956162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:19:04.959323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) Sep 13 20:19:04.961679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b014ee14-b858-4fd2-ac38-6ffdd1ea6092) {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 240.347917 Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-4e1a358d-d3c0-4018-af1d-303d7c635b09 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:19:04.964459 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:19:04.965533 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1335/2727] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:15:04 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 240349 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:04.994828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:05.006428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.098546 Sep 13 20:19:05.007002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:19:05.007002 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:19:05.007526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-45fde9ca-bbb9-48bf-a761-4b4089519d91 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:19:05.007526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:19:05.007526 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:19:05.007954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1393/2728] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:04 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:05.041252 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11000afd-6551-4b16-81dd-f5905971fb0f", "name": "network-vif-deleted", "tag": "1fcd70a1-2198-49dc-8b96-511dac023c32"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:19:05.051360 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.051846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.052270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.062687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] Creating event network-vif-deleted:1fcd70a1-2198-49dc-8b96-511dac023c32 for instance 11000afd-6551-4b16-81dd-f5905971fb0f on hv-cinder-82880 Sep 13 20:19:05.068690 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120184 Sep 13 20:19:05.069206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 13 20:19:05.069420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/os-server-external-events (10.222.0.23) Sep 13 20:19:05.070115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [req-bfbdf3ff-11cd-4816-82b7-ee30c9c820db req-ddeacaa0-af34-4fa1-920d-c5d3a4228965 service nova] Unhandled error: OSError: write error Sep 13 20:19:05.070115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:19:05.070115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:19:05.070446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1336/2729] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:05.075960 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.076534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:05.083082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.083563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.083996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.084679 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.085131 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.085556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.111875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:19:05.147921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f3e2a391-0074-45e1-a453-6a9b160d6439 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '.version_select at 0x7f6768a82700>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.166088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.compute.api [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:19:05.167093 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.095759 Sep 13 20:19:05.167741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (ip 10.222.0.23) !!! Sep 13 20:19:05.167741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:05 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (10.222.0.23) Sep 13 20:19:05.168385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-ba6a8a6a-65db-4e18-9aca-21e535741c3a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Unhandled error: OSError: write error Sep 13 20:19:05.168385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:19:05.168385 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:19:05.168754 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1337/2730] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:19:05 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:05.171071 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f3e2a391-0074-45e1-a453-6a9b160d6439 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 202 len: 0 microversion: 2.1 time: 0.162440 Sep 13 20:19:05.171572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:19:05.171572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:19:05.172139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-f3e2a391-0074-45e1-a453-6a9b160d6439 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Unhandled error: OSError: write error Sep 13 20:19:05.172139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:19:05.172139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:19:05.172423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1394/2731] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:19:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:05.173128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.173633 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:05.176649 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.177245 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:05.179427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.179903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.180340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.181017 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.181463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.181939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.182964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.183435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.183863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.184534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.184980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.185394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.246756 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:19:05.255346 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1376 microversion: 2.1 time: 0.082204 Sep 13 20:19:05.255843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:19:05.255843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:19:05.256411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-ab007aa8-b975-4a0e-80bc-48659e9628c4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:19:05.256411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:19:05.256411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:19:05.256704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1395/2732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:19:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:05.261403 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-297ce3b9-89d7-469a-8632-cfd64e4e183b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '.version_select at 0x7f67651d5f70>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.279465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-297ce3b9-89d7-469a-8632-cfd64e4e183b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-297ce3b9-89d7-469a-8632-cfd64e4e183b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Request method failure captured: Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 HTTP/1.1 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN8BvwdAiCLnOaVoCMy2EXwEP1k3o7TfjX4HE9grBuRa55t0TVmX3Ec1rfIkTQJuKIjKz8dmCj8bohGCPagsJxo9aOCnbXFNRCd5-oXtOfk3ug9QDb-jGr22g5eZk0vskLX0bQwaM5zLll9peenvv7a3kBRoRuhL85L3lMzGfArI7RA Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 1f154705e31748d9b7b8455ee5f73b70 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:19:05.282871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 1f154705e31748d9b7b8455ee5f73b70 Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-TestVolumeBootPattern-1894448896-project Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1e09b3554bb64828b857632d1de602d8 Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-TestVolumeBootPattern-1894448896-project Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:19:05.284693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-TestVolumeBootPattern-673951218'} Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:19:05.285831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:19:05.287561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:19:05.289168 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-297ce3b9-89d7-469a-8632-cfd64e4e183b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-297ce3b9-89d7-469a-8632-cfd64e4e183b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 404 len: 145 microversion: 2.1 time: 0.026843 Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-297ce3b9-89d7-469a-8632-cfd64e4e183b tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Unhandled error: OSError: write error Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:19:05.290951 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1396/2733] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:19:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:19:05.291687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.291687 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:05.296722 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.297196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.297648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.298326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.298770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.299186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.324047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:19:05.366591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.api [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:19:05.367313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1db53231-441e-4179-be03-f335b61dcbd5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.081091 Sep 13 20:19:05.367856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1397/2734] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:19:05 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:19:05.372858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:19:05.373328 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:19:05.378580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.379304 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.379736 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:05.380404 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:19:05.380847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:19:05.381266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:19:09.155287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:19:09.155785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:19:15.177244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:15.200363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:15.376858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:15.399698 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:19:23.536262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:19:23.536922 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:19:24.631007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:19:24.631470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:21:05.156130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:21:05.252678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'services' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:21:15.160714 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:15.256495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=4 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:21:16.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:21:16.798382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:21:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:22:29.165469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:22:29.166013 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:22:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:22:43.546539 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:22:43.547152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:22:44.640149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:22:44.640596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:23:05.580415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:23:05.583248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:23:05.585342 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:23:05.586762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:23:05.588239 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.590607 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.594024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) Sep 13 20:23:05.596983 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.598723 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0c1e4f3d-293a-4897-8a14-dc07aaabbdb2) {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:23:05.599796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 240.430301 Sep 13 20:23:05.600494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:23:05.600676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:23:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:23:05.601473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-923ba47c-2884-4e22-80f2-5ee9dfe0e5ef tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:23:05.601473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:23:05.601473 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:23:05.602156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1338/2735] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:19:05 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 240433 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.608595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.609408 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:05.618496 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.619446 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.620081 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.621011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.623152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.623785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.633067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:23:05.636286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:23:05.637898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:23:05.638899 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:23:05.640775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.643532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.646802 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) Sep 13 20:23:05.649239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-11996c89-bd09-4852-adad-bedc15394f8a) {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 400 len: 269 microversion: 2.1 time: 240.268891 Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-c9d2a536-16b9-4f7b-9ab0-6939363e0931 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:23:05.652021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:23:05.653215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1398/2736] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:19:05 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 240271 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.653215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-52a3fd83-b7b0-4a8f-8930-11a062c420b8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '.version_select at 0x7f67651e15e0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.659467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-52a3fd83-b7b0-4a8f-8930-11a062c420b8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-52a3fd83-b7b0-4a8f-8930-11a062c420b8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Request method failure captured: Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 HTTP/1.1 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN8BvwdAiCLnOaVoCMy2EXwEP1k3o7TfjX4HE9grBuRa55t0TVmX3Ec1rfIkTQJuKIjKz8dmCj8bohGCPagsJxo9aOCnbXFNRCd5-oXtOfk3ug9QDb-jGr22g5eZk0vskLX0bQwaM5zLll9peenvv7a3kBRoRuhL85L3lMzGfArI7RA Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 1f154705e31748d9b7b8455ee5f73b70 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:23:05.661390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 1f154705e31748d9b7b8455ee5f73b70 Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-TestVolumeBootPattern-1894448896-project Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-TestVolumeBootPattern-1894448896-project Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.663045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-TestVolumeBootPattern-673951218'} Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:23:05.663955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:23:05.667287 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.670832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-52a3fd83-b7b0-4a8f-8930-11a062c420b8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-52a3fd83-b7b0-4a8f-8930-11a062c420b8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 404 len: 145 microversion: 2.1 time: 0.022918 Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-52a3fd83-b7b0-4a8f-8930-11a062c420b8 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Unhandled error: OSError: write error Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:23:05.675012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1399/2737] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:23:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.676037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.676037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.676037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.676037 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'fault' on Instance uuid 10efef25-2b14-468a-9a72-0e6412d56a07 {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:23:05.676440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.676440 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:05.679519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.679519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.679519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.680369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.680848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.681291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.714207 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:05.715966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:23:05.722654 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1470 microversion: 2.1 time: 0.119329 Sep 13 20:23:05.723212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:23:05.723212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:23:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:23:05.723786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-21a34b66-7735-492e-9843-e4be6ee262e9 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:23:05.723786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:23:05.723786 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:23:05.725576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1339/2738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.731494 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.732365 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:05.738405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.738885 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.739508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.740388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.741011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.742202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.775400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.api [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:23:05.776351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.110142 Sep 13 20:23:05.776868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (ip 10.222.0.23) !!! Sep 13 20:23:05.776868 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (10.222.0.23) Sep 13 20:23:05.777435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-1d83aa82-ad50-4137-9c21-1fc44cf5281a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Unhandled error: OSError: write error Sep 13 20:23:05.777435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:23:05.777435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:23:05.777776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1400/2739] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:23:05 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.782653 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.783742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:05.790562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.791038 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.791512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.792198 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.792644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.793059 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.831308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.831609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.831904 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.832344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'fault' on Instance uuid 10efef25-2b14-468a-9a72-0e6412d56a07 {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:23:05.876801 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:23:05.885274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 200 len: 1470 microversion: 2.1 time: 0.106694 Sep 13 20:23:05.885840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:23:05.885840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:23:05.886481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-612f9a51-6b6f-4ec4-a2c5-d8bd41859c2f tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:23:05.886481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:23:05.886481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:23:05.886809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1401/2740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:23:05 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.890918 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-16832527-42d4-4018-abba-289c64527eb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Calling method '.version_select at 0x7f6768a8ab80>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.902645 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-16832527-42d4-4018-abba-289c64527eb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] HTTP exception thrown: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-16832527-42d4-4018-abba-289c64527eb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Request method failure captured: Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 HTTP/1.1 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN8BvwdAiCLnOaVoCMy2EXwEP1k3o7TfjX4HE9grBuRa55t0TVmX3Ec1rfIkTQJuKIjKz8dmCj8bohGCPagsJxo9aOCnbXFNRCd5-oXtOfk3ug9QDb-jGr22g5eZk0vskLX0bQwaM5zLll9peenvv7a3kBRoRuhL85L3lMzGfArI7RA Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 1f154705e31748d9b7b8455ee5f73b70 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:23:05.904420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f154705e31748d9b7b8455ee5f73b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 1f154705e31748d9b7b8455ee5f73b70 Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894448896 Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-TestVolumeBootPattern-1894448896-project Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-TestVolumeBootPattern-1894448896-project Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.906218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-TestVolumeBootPattern-673951218'} Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:23:05.907271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:23:05.908967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 Sep 13 20:23:05.910566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-16832527-42d4-4018-abba-289c64527eb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Returning 404 to user: Keypair tempest-TestVolumeBootPattern-673951218 not found for user 1e09b3554bb64828b857632d1de602d8 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-16832527-42d4-4018-abba-289c64527eb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 404 len: 145 microversion: 2.1 time: 0.018372 Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-16832527-42d4-4018-abba-289c64527eb3 tempest-TestVolumeBootPattern-1894448896 tempest-TestVolumeBootPattern-1894448896-project] Unhandled error: OSError: write error Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:23:05.912085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1402/2741] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:23:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:05.912870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:05.912870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:05.919235 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.919717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.920152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.920838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:05.921286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:05.921741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:05.949439 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:23:05.997423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.api [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:23:05.998833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.091024 Sep 13 20:23:05.999505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (ip 10.222.0.23) !!! Sep 13 20:23:05.999505 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:23:05 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (10.222.0.23) Sep 13 20:23:06.000085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-87260c52-6588-4f45-b0b0-b2b7d2313140 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Unhandled error: OSError: write error Sep 13 20:23:06.000085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:23:06.000085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:23:06.000371 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1403/2742] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:23:05 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:23:06.004782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:23:06.005269 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:23:06.015010 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:06.015501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:06.016400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:06.017102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:23:06.017551 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:23:06.019277 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:23:15.738491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:15.764144 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=12 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:16.009192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=14 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:23:16.040382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:24:26.860210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:24:26.860838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:24:36.807987 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:24:36.808555 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:24:58.557650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:58.560357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:58.562254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58158faa-6f98-4b2a-bf1f-abd43e7d22a6. Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:58.563086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.564563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.574547 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 404 to user: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:58.575444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 404 len: 154 microversion: 2.1 time: 112.848183 Sep 13 20:24:58.575969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:24:58.575969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:24:58.576577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-2ba5a892-5663-48a1-b91e-d478069e8cda tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:24:58.576577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:24:58.576577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:24:58.576925 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1340/2743] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:23:05 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 112850 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.600627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:58.603980 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:58.606495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58158faa-6f98-4b2a-bf1f-abd43e7d22a6. Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:58.607344 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.608697 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.611578 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 404 to user: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:58.613365 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 404 len: 154 microversion: 2.1 time: 112.612246 Sep 13 20:24:58.614248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:24:58.614248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:24:58.614961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:24:58.614961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:24:58.614961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:24:58.615248 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1404/2744] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:23:06 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 112614 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.778096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken: Token authorization failed Sep 13 20:24:58.779156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.162868 Sep 13 20:24:58.779661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:24:58.779661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:24:58.780266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-6560eebc-b46f-4478-a3b1-fc1e8f7c11c5 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:24:58.780266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:24:58.780266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:24:58.780515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1405/2745] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 165 msecs (HTTP/1.1 401) 6 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.789361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:58.789880 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:58.796985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.797752 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.798512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.799214 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.799664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.800082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.831893 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:24:58.843768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:58.844515 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:58.850568 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.851061 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.851501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.852256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.852708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.853132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.867030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 HTTP/1.1 Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:58.871655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.873359 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '10efef25-2b14-468a-9a72-0e6412d56a07'} Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:58.874296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.875702 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 404 len: 111 microversion: 2.1 time: 0.295445 Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-73a9fbf9-dcc9-4dd4-8d32-5839e6fb6416 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:24:58.877012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1341/2746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.881531 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:58.882115 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:58.891744 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.892243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.892684 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.893386 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.893869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.894307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.937503 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.155693 Sep 13 20:24:58.938161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (ip 10.222.0.23) !!! Sep 13 20:24:58.938161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (10.222.0.23) Sep 13 20:24:58.938846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-030bf145-b71b-45f8-a825-f876f7ad0b56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Unhandled error: OSError: write error Sep 13 20:24:58.938846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:24:58.938846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:24:58.939119 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1406/2747] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:58 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.944544 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:58.945543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:58.952411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.952989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.953457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.954137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.954583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.955008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.970191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 HTTP/1.1 Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:58.971662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.973173 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '10efef25-2b14-468a-9a72-0e6412d56a07'} Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:58.974079 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:58.975463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 404 len: 111 microversion: 2.1 time: 0.033081 Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:24:58.976763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1407/2748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.977373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken Sep 13 20:24:58.977373 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.001940 Sep 13 20:24:58.977686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:24:58.977686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:24:58.978276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-dae740dc-4d15-47d7-8415-4c29da34780a tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:24:58.978276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:24:58.978276 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:24:58.978688 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1408/2749] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 4 msecs (HTTP/1.1 401) 6 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:58.983077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:58.984024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:58.990157 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.990642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.991146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.991776 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:58.992221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:58.992619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:58.992748 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 HTTP/1.1 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:58.994270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:58.996178 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '9614bd92-6967-41b4-9bf0-d8206beda6dc', 'id': '58158faa-6f98-4b2a-bf1f-abd43e7d22a6'} Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58158faa-6f98-4b2a-bf1f-abd43e7d22a6. Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:58.997012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:58.999024 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 404 to user: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc is not attached to volume 58158faa-6f98-4b2a-bf1f-abd43e7d22a6 {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6" status: 404 len: 154 microversion: 2.1 time: 0.120867 Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (ip 10.222.0.23) !!! Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:58 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 (10.222.0.23) Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-0d7a92f6-de07-4924-9e7f-4498e88846a4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Unhandled error: OSError: write error Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:24:59.000300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1342/2750] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:24:58 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc/os-volume_attachments/58158faa-6f98-4b2a-bf1f-abd43e7d22a6 => generated 0 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:59.001510 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.002167 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 10efef25-2b14-468a-9a72-0e6412d56a07] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.007908 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.008391 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.008829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.009773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.010400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.010999 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.020420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:24:59.025800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 HTTP/1.1 Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:59.028085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:59.029660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '10efef25-2b14-468a-9a72-0e6412d56a07'} Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.031462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. Sep 13 20:24:59.034436 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Instance 10efef25-2b14-468a-9a72-0e6412d56a07 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07" status: 404 len: 111 microversion: 2.1 time: 0.031519 Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (ip 10.222.0.23) !!! Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:59 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 (10.222.0.23) Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:24:59.037338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1343/2751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:58 2022] GET /compute/v2.1/servers/10efef25-2b14-468a-9a72-0e6412d56a07 => generated 0 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.001917 Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (ip 10.222.0.23) !!! Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:24:59 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 (10.222.0.23) Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: CRITICAL nova [None req-d003e67a-78eb-4161-85bf-21b7ca47b812 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Unhandled error: OSError: write error Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova OSError: write error Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova Sep 13 20:24:59.039201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1344/2752] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 0 bytes in 3 msecs (HTTP/1.1 401) 6 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:59.040517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.040517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.046021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.046511 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.046949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.047676 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.048130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.048554 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.068200 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.api [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:24:59.069011 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.089384 Sep 13 20:24:59.069512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (ip 10.222.0.23) !!! Sep 13 20:24:59.069512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:24:59 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d (10.222.0.23) Sep 13 20:24:59.070115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: CRITICAL nova [None req-725688fe-ec86-46ee-a679-33e4ccbd2176 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Unhandled error: OSError: write error Sep 13 20:24:59.070115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova OSError: write error Sep 13 20:24:59.070115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova Sep 13 20:24:59.070405 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1409/2753] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:58 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Sep 13 20:24:59.073132 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:24:59.075110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c54a2bb5-dfc1-4184-a036-c595949052d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '.version_select at 0x7f67651d5ee0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.093483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c54a2bb5-dfc1-4184-a036-c595949052d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979" status: 202 len: 0 microversion: 2.1 time: 0.022293 Sep 13 20:24:59.094077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1410/2754] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:24:59.096285 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-c54a2bb5-dfc1-4184-a036-c595949052d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken Sep 13 20:24:59.097022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c54a2bb5-dfc1-4184-a036-c595949052d4 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.001940 Sep 13 20:24:59.097486 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1411/2755] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 114 bytes in 3 msecs (HTTP/1.1 401) 6 headers in 293 bytes (1 switches on core 0) Sep 13 20:24:59.101862 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.102353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.108771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.109249 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.109713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.110396 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.110845 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.111266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.119703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.compute.api [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:24:59.121317 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-18372067-6cda-4200-bb67-b91e5afe5c8d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.085463 Sep 13 20:24:59.121923 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1345/2756] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:24:59.126501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '.version_select at 0x7f6765185550>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.135920 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:24:59.143502 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 HTTP/1.1 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:59.146525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.148325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'tempest-keypair-231488979'} Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:59.149321 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:24:59.151209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.153663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.155082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.155082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979" status: 404 len: 131 microversion: 2.1 time: 0.024987 Sep 13 20:24:59.155082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1346/2757] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 => generated 131 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.155082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken Sep 13 20:24:59.155082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-795c2eb3-1994-4dae-b15a-241fe85a4283 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.001947 Sep 13 20:24:59.155082 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1347/2758] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 114 bytes in 3 msecs (HTTP/1.1 401) 6 headers in 293 bytes (1 switches on core 0) Sep 13 20:24:59.161018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.161018 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.163833 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.164303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.164733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.165417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.165896 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.166320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.181648 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.compute.api [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:24:59.182470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f0c42724-aa60-4be4-b4e8-82ba6206e9d6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.084016 Sep 13 20:24:59.184431 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1412/2759] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:24:59.188910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5aff1ae-b884-4f44-807d-635a71a8578e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '.version_select at 0x7f6765062040>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.198426 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:24:59.201599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-c5aff1ae-b884-4f44-807d-635a71a8578e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5aff1ae-b884-4f44-807d-635a71a8578e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 HTTP/1.1 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.203780 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.205506 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-keypair-231488979'} Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:59.206746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:24:59.208070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.209461 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.210768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c5aff1ae-b884-4f44-807d-635a71a8578e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.210768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c5aff1ae-b884-4f44-807d-635a71a8578e tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979" status: 404 len: 131 microversion: 2.1 time: 0.020016 Sep 13 20:24:59.210768 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1413/2760] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 => generated 131 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.259400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.compute.api [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Instance is already in deleting state, ignoring this request Sep 13 20:24:59.260357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9ed35616-ca10-4a61-875a-2f2e85827fea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 204 len: 0 microversion: 2.1 time: 0.107292 Sep 13 20:24:59.260975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1348/2761] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:24:59.379223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.379972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.387843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.388678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.389426 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.390527 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.391278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.392061 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.409453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 HTTP/1.1 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.411814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.413704 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'f9496396-f352-4a04-8d1d-f677e8315b96'} Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.414760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.417064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.418940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.418940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 404 len: 111 microversion: 2.1 time: 0.206159 Sep 13 20:24:59.418940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1414/2762] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.418940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: WARNING keystonemiddleware.auth_token [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken Sep 13 20:24:59.418940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bb37dafa-204b-494a-9a1f-e6fb252478b0 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.002290 Sep 13 20:24:59.418940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1415/2763] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 114 bytes in 3 msecs (HTTP/1.1 401) 6 headers in 293 bytes (1 switches on core 0) Sep 13 20:24:59.422836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-62beeb0b-8f47-4688-abf1-0a35905519e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '.version_select at 0x7f6765080160>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.427054 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.427558 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.440209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.440965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.442011 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.443338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.443584 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.444254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.454309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-62beeb0b-8f47-4688-abf1-0a35905519e7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397582461" status: 202 len: 0 microversion: 2.1 time: 0.035064 Sep 13 20:24:59.457336 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1416/2764] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397582461 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:24:59.461160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.462685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bccc3971-bf40-419a-8745-8f560193ac60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '.version_select at 0x7f6764fb4ee0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 HTTP/1.1 Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:59.462838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.464990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '1e0d01e4-a3dc-4f0e-91fe-19875dca7be4'} Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.466048 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.467838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.469627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.469627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ae3e2054-26ac-4553-af77-7d6cfa0c1a7b tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 404 len: 111 microversion: 2.20 time: 0.201591 Sep 13 20:24:59.469627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1349/2765] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:24:59.469627 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.470029 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.476023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.476429 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.476893 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.477577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.478097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.478518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.484850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-bccc3971-bf40-419a-8745-8f560193ac60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bccc3971-bf40-419a-8745-8f560193ac60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 HTTP/1.1 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.487400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.489174 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-keypair-231488979'} Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:59.490430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:24:59.492118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.494083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.496559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-bccc3971-bf40-419a-8745-8f560193ac60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.496559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-bccc3971-bf40-419a-8745-8f560193ac60 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979" status: 404 len: 131 microversion: 2.1 time: 0.031163 Sep 13 20:24:59.496559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1417/2766] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 => generated 131 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.496876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 HTTP/1.1 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:59.497771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.501172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'f9496396-f352-4a04-8d1d-f677e8315b96'} Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.502310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.504835 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.506628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.506628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 404 len: 111 microversion: 2.1 time: 0.032772 Sep 13 20:24:59.506628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1350/2767] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.506628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: WARNING keystonemiddleware.auth_token [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Authorization failed for token: keystonemiddleware.auth_token._exceptions.InvalidToken Sep 13 20:24:59.506628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-88e1706a-0c11-4d58-b22d-307245b09285 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218" status: 401 len: 114 microversion: - time: 0.001972 Sep 13 20:24:59.506628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1351/2768] 10.222.0.23 () {58 vars in 1260 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673951218 => generated 114 bytes in 3 msecs (HTTP/1.1 401) 6 headers in 293 bytes (1 switches on core 0) Sep 13 20:24:59.507323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.507323 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.514523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.516202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.516202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.516467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.517562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.518085 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.534794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 HTTP/1.1 Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.536849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.538794 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '1e0d01e4-a3dc-4f0e-91fe-19875dca7be4'} Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.540599 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.543297 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.545009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.545009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7105ad26-17fc-4640-b263-2b80af691141 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 404 len: 111 microversion: 2.20 time: 0.041915 Sep 13 20:24:59.545009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1418/2769] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:24:59.546077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e50b0c3e-423e-42e3-802b-ec4d5bc6d6ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '.version_select at 0x7f6764fb40d0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.558208 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-e50b0c3e-423e-42e3-802b-ec4d5bc6d6ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Keypair tempest-keypair-397582461 not found for user 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e50b0c3e-423e-42e3-802b-ec4d5bc6d6ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-397582461 HTTP/1.1 Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.560271 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-keypair-397582461 not found for user 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-keypair-397582461'} Sep 13 20:24:59.561928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:24:59.563036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-397582461 not found for user 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:24:59.564566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-397582461 not found for user 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-397582461 not found for user 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:24:59.566126 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.567522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e50b0c3e-423e-42e3-802b-ec4d5bc6d6ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Keypair tempest-keypair-397582461 not found for user 61b9ae7499154e5eab4f3c23d8bb6785 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.567522 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e50b0c3e-423e-42e3-802b-ec4d5bc6d6ce tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397582461" status: 404 len: 131 microversion: 2.1 time: 0.019907 Sep 13 20:24:59.567708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-e8c1b51f-00f9-44b5-b2c7-ca6d9143c630 req-4b33b4c8-ec3f-45dd-9d7e-c4918b909e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d5be8a-859b-4ba2-a738-a9fa561a778d", "name": "network-vif-deleted", "tag": "ccda5d7b-dfeb-449f-ad37-6ddf4890923d"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:24:59.568203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1419/2770] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397582461 => generated 131 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.571042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-78b86285-88a8-4d3f-912a-93ea80e95205 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '.version_select at 0x7f6765080160>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.573170 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-e8c1b51f-00f9-44b5-b2c7-ca6d9143c630 req-4b33b4c8-ec3f-45dd-9d7e-c4918b909e94 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.573672 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-e8c1b51f-00f9-44b5-b2c7-ca6d9143c630 req-4b33b4c8-ec3f-45dd-9d7e-c4918b909e94 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.574143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-e8c1b51f-00f9-44b5-b2c7-ca6d9143c630 req-4b33b4c8-ec3f-45dd-9d7e-c4918b909e94 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.583949 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-78b86285-88a8-4d3f-912a-93ea80e95205 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.585381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-e8c1b51f-00f9-44b5-b2c7-ca6d9143c630 req-4b33b4c8-ec3f-45dd-9d7e-c4918b909e94 service nova] Creating event network-vif-deleted:ccda5d7b-dfeb-449f-ad37-6ddf4890923d for instance c4d5be8a-859b-4ba2-a738-a9fa561a778d on hv-cinder-82880 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-78b86285-88a8-4d3f-912a-93ea80e95205 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 HTTP/1.1 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.585733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.588919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'tempest-keypair-231488979'} Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise self.value Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:24:59.590513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 20:24:59.594253 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:24:59.596113 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.597667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-78b86285-88a8-4d3f-912a-93ea80e95205 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Keypair tempest-keypair-231488979 not found for user a0e295fda2af4157b196c6130aa2d6d2 {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.597667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-78b86285-88a8-4d3f-912a-93ea80e95205 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979" status: 404 len: 131 microversion: 2.1 time: 0.019663 Sep 13 20:24:59.597667 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1420/2771] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231488979 => generated 131 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.597965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-e8c1b51f-00f9-44b5-b2c7-ca6d9143c630 req-4b33b4c8-ec3f-45dd-9d7e-c4918b909e94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091070 Sep 13 20:24:59.597965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1352/2772] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:24:59.600496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.600496 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.600768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.602030 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.606843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.607423 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.608165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.608946 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.609491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.609751 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.610025 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.610360 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.610491 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.611162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.611664 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.612100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.625313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 HTTP/1.1 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.627098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.628934 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'f9496396-f352-4a04-8d1d-f677e8315b96'} Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.630022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.631855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.633681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.633800 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 HTTP/1.1 Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:24:59.633916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.635804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '1e0d01e4-a3dc-4f0e-91fe-19875dca7be4'} Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.638155 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.639640 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.642826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.642826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-626b2174-c1c5-4cde-83b3-667e1fbe4785 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 404 len: 111 microversion: 2.20 time: 0.034529 Sep 13 20:24:59.643017 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-86da464a-077b-42ae-99d2-d049478077fb tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 404 len: 111 microversion: 2.1 time: 0.042902 Sep 13 20:24:59.643153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1353/2773] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:24:59.643153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.643153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.643449 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1421/2774] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.646712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.646892 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.647201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.647634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.648324 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.648774 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.649195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.658787 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.672212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.673317 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.674322 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.675205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.675828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.676573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.694588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 HTTP/1.1 Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.696990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.700286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '1e0d01e4-a3dc-4f0e-91fe-19875dca7be4'} Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.702175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. Sep 13 20:24:59.705266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.708751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:24:59.709298 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance 1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.710301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-90a7d88f-fb0f-4242-ba0c-1d04c09c35d6 tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4" status: 404 len: 111 microversion: 2.20 time: 0.068082 Sep 13 20:24:59.711341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1422/2775] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 20:24:59 2022] GET /compute/v2.1/servers/1e0d01e4-a3dc-4f0e-91fe-19875dca7be4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:24:59.722465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.723549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: f9496396-f352-4a04-8d1d-f677e8315b96] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.734374 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.737861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.737995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.739081 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.739957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.742810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.790662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 HTTP/1.1 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:24:59.796102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.797680 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'f9496396-f352-4a04-8d1d-f677e8315b96'} Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:24:59.798564 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. Sep 13 20:24:59.801446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:24:59.803545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance f9496396-f352-4a04-8d1d-f677e8315b96 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:24:59.803545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2f759259-2321-4a38-9cbc-a2db482ba01a tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96" status: 404 len: 111 microversion: 2.1 time: 0.085326 Sep 13 20:24:59.803545 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1423/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:59 2022] GET /compute/v2.1/servers/f9496396-f352-4a04-8d1d-f677e8315b96 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:24:59.920609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-721b10e8-b868-45f6-bd2c-73eb2f785d04 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 204 len: 0 microversion: 2.1 time: 0.283639 Sep 13 20:24:59.923174 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1354/2777] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:24:59 2022] DELETE /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:24:59.932766 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:24:59.934022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:24:59.941098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.942001 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.942808 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:24:59.944101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:24:59.944664 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:24:59.945334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:00.102279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:00.120456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-7fb99c71-9cc7-4635-aee9-34e6592271c4 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1513 microversion: 2.1 time: 0.192040 Sep 13 20:25:00.121479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1424/2778] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:24:59 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:00.539712 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-db84adbd-9939-4696-bc56-d18bda8f6f78 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: .version_select at 0x7f6765201700>, body: {"keypair": {"name": "tempest-keypair-2093985672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf0I7r7NoJVKY9E34O6UOmjqiSwD+lgQjO/qWvufZ0MrgYhkuzWuTIrQyAuuqcodB6YuFjzZuxWGiuBQ1Gl1HIdxKtLTOZb8vBlH2sodwW/WwkrCylrXVXeepd7BAzzUA=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:00.557965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-db84adbd-9939-4696-bc56-d18bda8f6f78 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:25:00.562369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-db84adbd-9939-4696-bc56-d18bda8f6f78 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:25:00.600041 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-db84adbd-9939-4696-bc56-d18bda8f6f78 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064241 Sep 13 20:25:00.602153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1355/2779] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 20:25:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:00.969067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:00.970326 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:00.978565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:00.979399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:00.980580 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:00.981487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:00.982188 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:00.982678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:00.998693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 HTTP/1.1 Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:25:01.000857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.002494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'c34b27c6-038e-4f56-80f6-2c4d987b43e4'} Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:01.003332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.004810 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.008042 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:01.008995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-dd900707-28df-44ee-9412-721075c6038e tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 404 len: 111 microversion: 2.20 time: 0.045200 Sep 13 20:25:01.010095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1425/2780] 10.222.0.23 () {60 vars in 1280 bytes} [Tue Sep 13 20:25:00 2022] DELETE /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:25:01.019500 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:01.020312 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] [instance: c34b27c6-038e-4f56-80f6-2c4d987b43e4] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:01.027552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:01.028439 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.028967 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.029396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.030234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.030651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.031057 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.031966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:01.040691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.041263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.041748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.043309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.044097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.044392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.047114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] HTTP exception thrown: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Request method failure captured: Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 HTTP/1.1 Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7FK4tBCRJFOpAXDEjY56nDek3BDfonVEmmddpTlrI2-M09cRDIXub0Ha3vpq0b2GTMs4m9b9zBWnVRgyAf41jFnRqvHrEbNfbJV48U_R2PhmXWILZEDJDv2SKMx_0WhEvsb4Uq7hOTP-FX7FjfkjFRKGY1UP-FwE6PgTU9MxIHmow Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:25:01.049277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f03c01ff6ef24c59b65362c66ad1a1ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: f03c01ff6ef24c59b65362c66ad1a1ea Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781989095 Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 3177776f47ef4d3e937c2e8efb360e79 Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781989095-project Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.051415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'c34b27c6-038e-4f56-80f6-2c4d987b43e4'} Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:01.052353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. Sep 13 20:25:01.054481 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.055862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] Returning 404 to user: Instance c34b27c6-038e-4f56-80f6-2c4d987b43e4 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:01.055862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8356f7d5-6d7b-420c-8de8-17e9c810775a tempest-AttachVolumeShelveTestJSON-1781989095 tempest-AttachVolumeShelveTestJSON-1781989095-project] 10.222.0.23 "GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4" status: 404 len: 111 microversion: 2.20 time: 0.036806 Sep 13 20:25:01.055862 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1356/2781] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Sep 13 20:25:01 2022] GET /compute/v2.1/servers/c34b27c6-038e-4f56-80f6-2c4d987b43e4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:25:01.061026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 HTTP/1.1 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:25:01.062679 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.064570 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '3965b308-7b06-4c6b-8cf6-a14e471c13b9'} Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:01.066592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.068138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.069838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:01.069838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-266cdbbf-6c8f-4c1f-989f-b534f13b0947 tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 404 len: 111 microversion: 2.1 time: 0.043717 Sep 13 20:25:01.069838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1426/2782] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:25:01 2022] DELETE /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:25:01.075427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:01.076218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] [instance: 3965b308-7b06-4c6b-8cf6-a14e471c13b9] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:01.083431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.084106 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.084771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.085904 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.086450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.087308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.113114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] HTTP exception thrown: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Request method failure captured: Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 HTTP/1.1 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6-CJ_i6wZxg_tegIL7RtBfno21tfMAkBYOZ8itifm2CUizi4UJEOR8Jfhya13nOZlGVY9a-ZnPuSp13GPiX0lLWuL8DyddMR3Eva3m7ggYYozTwFUzKyWBOHLalA5t_zNAzpn7G55SfEw4ldaHu-tVPzfp90z4XK_hYxnhZmmwzw4 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:25:01.115063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2981eddb8742492fac516851f761e2f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2981eddb8742492fac516851f761e2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2981eddb8742492fac516851f761e2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 2981eddb8742492fac516851f761e2f9 Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-69837582 Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 15069aa932aa473983c4102961b855d5 Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeTestJSON-69837582-project Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.117427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '3965b308-7b06-4c6b-8cf6-a14e471c13b9'} Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:01.119028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. Sep 13 20:25:01.122328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:01.123917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] Returning 404 to user: Instance 3965b308-7b06-4c6b-8cf6-a14e471c13b9 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:01.123917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8da936d6-3501-4e93-a096-ae7d04cbfd6f tempest-AttachVolumeTestJSON-69837582 tempest-AttachVolumeTestJSON-69837582-project] 10.222.0.23 "GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9" status: 404 len: 111 microversion: 2.1 time: 0.046591 Sep 13 20:25:01.123917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1357/2783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:01 2022] GET /compute/v2.1/servers/3965b308-7b06-4c6b-8cf6-a14e471c13b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:25:01.150668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:01.151483 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:01.158448 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.159014 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.159807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.161638 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.162311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.163021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.212646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.213491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.213963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.214587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lazy-loading 'fault' on Instance uuid 9614bd92-6967-41b4-9bf0-d8206beda6dc {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:25:01.270463 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1500cbd765c74fa488e678dda25f5e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030d7bb8d92404e9083b3847fcb0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:01.281435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cd65fe20-c403-4c1e-a2ec-39a305753a0d tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 200 len: 1308 microversion: 2.1 time: 0.140025 Sep 13 20:25:01.283320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1427/2784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:01 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:01.618739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-a0fb59c9-ce73-4d1e-84b3-a40229bfed67 req-dd4f76c2-1ad0-49b0-a511-4bfda8d9d120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9614bd92-6967-41b4-9bf0-d8206beda6dc", "name": "network-vif-deleted", "tag": "c6bfa8b1-3373-4b8f-9840-c7faa918bb8a"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:01.639034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a0fb59c9-ce73-4d1e-84b3-a40229bfed67 req-dd4f76c2-1ad0-49b0-a511-4bfda8d9d120 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:01.639508 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a0fb59c9-ce73-4d1e-84b3-a40229bfed67 req-dd4f76c2-1ad0-49b0-a511-4bfda8d9d120 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:01.640152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-a0fb59c9-ce73-4d1e-84b3-a40229bfed67 req-dd4f76c2-1ad0-49b0-a511-4bfda8d9d120 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:01.657147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-a0fb59c9-ce73-4d1e-84b3-a40229bfed67 req-dd4f76c2-1ad0-49b0-a511-4bfda8d9d120 service nova] Creating event network-vif-deleted:c6bfa8b1-3373-4b8f-9840-c7faa918bb8a for instance 9614bd92-6967-41b4-9bf0-d8206beda6dc on hv-cinder-82880 Sep 13 20:25:01.679604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-a0fb59c9-ce73-4d1e-84b3-a40229bfed67 req-dd4f76c2-1ad0-49b0-a511-4bfda8d9d120 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063697 Sep 13 20:25:01.681243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1358/2785] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:02.165993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1871830400", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35be4e76-9541-4147-ba24-d2a973f5a0c4"}], "security_groups": [{"name": "tempest-securitygroup--456434339"}], "key_name": "tempest-keypair-2093985672", "user_data": "}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:02.272959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] validate_networks() for [('35be4e76-9541-4147-ba24-d2a973f5a0c4', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:25:02.306942 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:02.307546 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] [instance: 9614bd92-6967-41b4-9bf0-d8206beda6dc] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:02.313956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:02.314441 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:02.314878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:02.315559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:02.316006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:02.316641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:02.330259 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] HTTP exception thrown: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc could not be found. Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Request method failure captured: Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc HTTP/1.1 Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN9rQ24Sznu4YEooDIczCUMXCayRyXhAtBwTRqkWKRGNVRnRKJmjrWBTJW0hi0m9T6RX8rt2CIxwbq5SKHypTLNdO_EwU-MmlD4TvoN6znWIX2H5JlBwlZMlT_L-jD94dMWh4qnJ-jVDvT2a-6TJXqc2f9UU_Gx3--TJjK8Xav6uOlI Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:25:02.332158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d030d7bb8d92404e9083b3847fcb0487"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d030d7bb8d92404e9083b3847fcb0487 Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-331130650 Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 1500cbd765c74fa488e678dda25f5e58 Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotTestJSON-331130650-project Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc could not be found. Sep 13 20:25:02.333940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '9614bd92-6967-41b4-9bf0-d8206beda6dc'} Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc could not be found. Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:02.334949 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc could not be found. Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc could not be found. Sep 13 20:25:02.336666 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:02.338834 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] Returning 404 to user: Instance 9614bd92-6967-41b4-9bf0-d8206beda6dc could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:02.340442 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-67b6df59-0c36-41a2-bf45-a8d60bd4baf1 tempest-VolumesSnapshotTestJSON-331130650 tempest-VolumesSnapshotTestJSON-331130650-project] 10.222.0.23 "GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc" status: 404 len: 111 microversion: 2.1 time: 0.037811 Sep 13 20:25:02.341176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1359/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:02 2022] GET /compute/v2.1/servers/9614bd92-6967-41b4-9bf0-d8206beda6dc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:25:02.801919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:25:02.802410 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:25:02.802973 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:25:02.803628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:25:02.804236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:25:02.813485 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:02.813921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:02.814349 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:02.815052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:02.815676 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:02.816093 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:02.832849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:25:02.836795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Getting quotas for user 61b9ae7499154e5eab4f3c23d8bb6785 and project 552017cc73234b8db2ac15a8496e649e. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:25:02.848279 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:25:02.850633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:25:02.906291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-6e3ccf76-db91-44da-aa60-6b607a8b6f56 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.744501 Sep 13 20:25:02.907367 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1428/2787] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 20:25:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:25:02.918251 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a9516a31-03a1-4ba1-aa84-90194810f59d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:02.919434 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a9516a31-03a1-4ba1-aa84-90194810f59d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:02.992291 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a9516a31-03a1-4ba1-aa84-90194810f59d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:02.999995 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a9516a31-03a1-4ba1-aa84-90194810f59d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1242 microversion: 2.1 time: 0.085906 Sep 13 20:25:03.000797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1360/2788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:02 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:04.031926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:04.036712 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:04.045262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:04.046242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:04.046897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:04.052867 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:04.053574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:04.054289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:04.161761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:04.171537 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-12f5e0fb-d89e-4643-8b6c-c4f5059fbfab tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1294 microversion: 2.1 time: 0.148971 Sep 13 20:25:04.173239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1429/2789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:04 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1294 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:05.199280 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:05.199982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:05.208036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:05.208517 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:05.208950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:05.210267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:05.210730 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:05.211149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:05.297771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:05.327650 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8a74865d-9963-44a4-92fe-8e0c732d55bd tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1302 microversion: 2.1 time: 0.111272 Sep 13 20:25:05.328777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1361/2790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:05 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:25:06.351947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:06.353098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:06.366821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:06.367422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:06.368223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:06.369028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:06.370139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:06.371894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:06.459225 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:06.469509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a5595bbf-74e5-47a2-81a3-d45782e9e5c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1302 microversion: 2.1 time: 0.121656 Sep 13 20:25:06.471154 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1430/2791] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:06 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:07.495882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:07.496529 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:07.507805 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:07.508445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:07.508933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:07.509668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:07.510296 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:07.510726 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:07.588282 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:07.597851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-71b7960a-3442-4e8a-ad5c-2d22fc832356 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1300 microversion: 2.1 time: 0.108351 Sep 13 20:25:07.598335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1362/2792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:07 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:08.105689 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-55f434be-a66f-4455-9863-2eb7de4c8708 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Action: 'create', calling method: .version_select at 0x7f67651cff70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-991646856"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:08.621299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:08.622143 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:08.636301 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:08.638140 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:08.640628 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:08.643183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:08.644807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:08.647820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:08.667572 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-55f434be-a66f-4455-9863-2eb7de4c8708 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.881279 Sep 13 20:25:08.668548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1431/2793] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Sep 13 20:25:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 884 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 20:25:08.677232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-1e12943a-9889-446b-90e5-3790c46c767d req-e3a119f6-f759-4129-b229-275897c0737c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cce6e1-87db-41a8-b70c-e80a55552f0b", "tag": "edf2b37f-8c10-44cd-a612-ebe19912eb38"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:08.710184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-1e12943a-9889-446b-90e5-3790c46c767d req-e3a119f6-f759-4129-b229-275897c0737c service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:08.711343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-1e12943a-9889-446b-90e5-3790c46c767d req-e3a119f6-f759-4129-b229-275897c0737c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:08.713027 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-1e12943a-9889-446b-90e5-3790c46c767d req-e3a119f6-f759-4129-b229-275897c0737c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:08.747585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-1e12943a-9889-446b-90e5-3790c46c767d req-e3a119f6-f759-4129-b229-275897c0737c service nova] Creating event network-changed:edf2b37f-8c10-44cd-a612-ebe19912eb38 for instance 76cce6e1-87db-41a8-b70c-e80a55552f0b on hv-cinder-82880 Sep 13 20:25:08.767659 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-1e12943a-9889-446b-90e5-3790c46c767d req-e3a119f6-f759-4129-b229-275897c0737c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097571 Sep 13 20:25:08.768937 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1432/2794] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:08.777482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-666e18d2-d3a5-4d06-84e4-23263b45eba8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6764fb4af0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:08.844818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-666e18d2-d3a5-4d06-84e4-23263b45eba8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 200 len: 344 microversion: 2.1 time: 0.074215 Sep 13 20:25:08.845384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1433/2795] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:08 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:08.879335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:08.888917 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-df497bed-8e77-4c58-a1c1-bbbe9dad502d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.272429 Sep 13 20:25:08.889973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1363/2796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:08 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:25:09.860229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-23d67a93-8b5d-41cf-a3fe-482baa5437c4 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67651cfb80>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:09.906910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-23d67a93-8b5d-41cf-a3fe-482baa5437c4 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 200 len: 345 microversion: 2.1 time: 0.050909 Sep 13 20:25:09.913888 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1434/2797] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:09 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:09.919957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:09.920739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:09.922264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f7900bf8-a2e2-43ad-8c05-6a74814a30b9 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Action: 'create', calling method: .version_select at 0x7f6765062940>, body: {"snapshot": {"volume_id": "244451a3-2fa2-447f-ad27-d0da78e1df47", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1891708130"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:09.927396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:09.928095 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:09.928539 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:09.929447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:09.929940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:09.930406 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:10.096415 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:10.108796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-fca0f88d-c016-463e-8302-ca70146377b7 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.193153 Sep 13 20:25:10.122708 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1364/2798] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:09 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:10.153948 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f7900bf8-a2e2-43ad-8c05-6a74814a30b9 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.235578 Sep 13 20:25:10.154523 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1435/2799] 10.222.0.23 () {60 vars in 1162 bytes} [Tue Sep 13 20:25:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:25:10.168842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-75d67b6f-a44d-4256-adf0-0dc159e85913 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f676507e550>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:10.206762 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-75d67b6f-a44d-4256-adf0-0dc159e85913 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 200 len: 287 microversion: 2.1 time: 0.044671 Sep 13 20:25:10.207357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1365/2800] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:10 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:10.219222 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31a2cfaf-03f1-4826-9fc2-688cd30022e0 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67651e1430>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:10.262033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-31a2cfaf-03f1-4826-9fc2-688cd30022e0 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.046434 Sep 13 20:25:10.262773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1436/2801] 10.222.0.23 () {58 vars in 1140 bytes} [Tue Sep 13 20:25:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:10.273956 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-489be172-d462-4fa7-8259-31fd4a1a435c tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6768a90550>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:10.306224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-489be172-d462-4fa7-8259-31fd4a1a435c tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 200 len: 287 microversion: 2.1 time: 0.035716 Sep 13 20:25:10.307159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1366/2802] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:10 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:11.134275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:11.135007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:11.141560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:11.142082 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:11.142521 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:11.143201 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:11.143647 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:11.144263 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:11.285329 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:11.294370 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-15ee5030-5eb8-40e3-89c3-3323f189c622 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.164400 Sep 13 20:25:11.294974 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1437/2803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:11 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:11.320964 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-79493200-86aa-4a96-8046-e7e6cb2cdfdd tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67650b4430>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:11.353488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-79493200-86aa-4a96-8046-e7e6cb2cdfdd tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 200 len: 287 microversion: 2.1 time: 0.038091 Sep 13 20:25:11.354099 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1367/2804] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:11 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:12.317377 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:12.318034 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:12.325646 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:12.326142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:12.326642 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:12.327332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:12.327947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:12.328556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:12.334943 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:12.367214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ac4d371e-f8d7-4e2c-a009-c1edfd051532 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67652489d0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:12.403843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ac4d371e-f8d7-4e2c-a009-c1edfd051532 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 200 len: 287 microversion: 2.1 time: 0.040679 Sep 13 20:25:12.409182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1368/2805] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:12 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:12.767091 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:12.777359 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2539f9b2-4461-4b79-b59b-622d4fca9e34 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.464056 Sep 13 20:25:12.778813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1438/2806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:12 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:13.413288 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:13.418465 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d8a53d09-4e57-4ba8-ac01-4bdc48ed6c06 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6764fcbaf0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:13.454581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d8a53d09-4e57-4ba8-ac01-4bdc48ed6c06 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 200 len: 288 microversion: 2.1 time: 0.042054 Sep 13 20:25:13.455147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1369/2807] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:13 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:13.466437 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-74b5e803-6d6f-4b6b-b860-65dd9834d6c2 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67651cf430>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:13.472775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:13.473504 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=6 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:13.537205 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-74b5e803-6d6f-4b6b-b860-65dd9834d6c2 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 202 len: 0 microversion: 2.1 time: 0.074686 Sep 13 20:25:13.538750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1439/2808] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Sep 13 20:25:13 2022] DELETE /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:25:13.548850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-201c32ab-287c-475f-8a43-e9170b21be9c tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6764fcb4c0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:13.581683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-201c32ab-287c-475f-8a43-e9170b21be9c tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 200 len: 287 microversion: 2.1 time: 0.038404 Sep 13 20:25:13.582261 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1370/2809] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:13 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:13.804056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:13.804661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:13.811128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:13.811609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:13.812039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:13.812717 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:13.813197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:13.813587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:13.949299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:13.957224 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f51e6908-eec0-4a7a-95f6-a1d977b0cce2 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.157006 Sep 13 20:25:13.957816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1440/2810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:13 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:14.598153 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-de7abc8a-6a00-4c1a-9398-0d5e95af01f8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6764fcb8b0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:14.661768 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-de7abc8a-6a00-4c1a-9398-0d5e95af01f8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] HTTP exception thrown: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-de7abc8a-6a00-4c1a-9398-0d5e95af01f8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Request method failure captured: Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 HTTP/1.1 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIOcjTpQQMpXwZG2Be0LRdL1xBgB0teTq9fz6FsEXqfJEYCUmmK_8zWTmOrQLJ3g1CYfy2--uSeolHUO-kOhOgZU9G3r_-xJJOCIUCElvxFZONWqntgsnsKG9nk83wiWWba95DDw84_IxhoC6tGkWKID5EqQUdtg6173QgSlNYoMqPO0 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:25:14.664228 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f02786494b4a1a901c0d6240921180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 17d37e2bf6324ee88f9f70da52cc63f4 Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'cd16df6e-2e21-4b2d-85c2-97251186fbe8'} Sep 13 20:25:14.666138 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. (HTTP 404) (Request-ID: req-4da8519f-f664-4088-9202-0ecdd7588035) Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.667595 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:25:14.669021 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 20:25:14.670888 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-de7abc8a-6a00-4c1a-9398-0d5e95af01f8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Returning 404 to user: Snapshot cd16df6e-2e21-4b2d-85c2-97251186fbe8 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:14.672602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-de7abc8a-6a00-4c1a-9398-0d5e95af01f8 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8" status: 404 len: 111 microversion: 2.1 time: 0.074200 Sep 13 20:25:14.673783 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1371/2811] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Sep 13 20:25:14 2022] GET /compute/v2.1/os-snapshots/cd16df6e-2e21-4b2d-85c2-97251186fbe8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:25:14.676083 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-28bc54ea-9434-41d5-b3ad-e339ee217fa0 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67651e1a60>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:14.740097 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-28bc54ea-9434-41d5-b3ad-e339ee217fa0 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 202 len: 0 microversion: 2.1 time: 0.068631 Sep 13 20:25:14.740857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1441/2812] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 20:25:14 2022] DELETE /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:25:14.749499 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-3da46458-fbac-44ca-9a73-d6e8084740c6 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6768a909d0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:14.813553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-3da46458-fbac-44ca-9a73-d6e8084740c6 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 200 len: 344 microversion: 2.1 time: 0.067068 Sep 13 20:25:14.813553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1372/2813] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:14 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:14.980065 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:14.980685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:14.986541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:14.986954 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:14.987384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:14.988053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:14.988497 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:14.988907 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:15.126194 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:15.134112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1f179e17-923e-401c-8f4e-8873994fdb5f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.157730 Sep 13 20:25:15.134690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1442/2814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:14 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:15.193219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-75028e5c-68c6-4e9e-9cc9-3d7fd9d94ef4 req-01401feb-1141-48da-adf6-cad9989f5ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cce6e1-87db-41a8-b70c-e80a55552f0b", "name": "network-vif-plugged", "status": "completed", "tag": "edf2b37f-8c10-44cd-a612-ebe19912eb38"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:15.203120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-75028e5c-68c6-4e9e-9cc9-3d7fd9d94ef4 req-01401feb-1141-48da-adf6-cad9989f5ef8 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:15.203586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-75028e5c-68c6-4e9e-9cc9-3d7fd9d94ef4 req-01401feb-1141-48da-adf6-cad9989f5ef8 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:15.204005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-75028e5c-68c6-4e9e-9cc9-3d7fd9d94ef4 req-01401feb-1141-48da-adf6-cad9989f5ef8 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:15.214335 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-75028e5c-68c6-4e9e-9cc9-3d7fd9d94ef4 req-01401feb-1141-48da-adf6-cad9989f5ef8 service nova] Creating event network-vif-plugged:edf2b37f-8c10-44cd-a612-ebe19912eb38 for instance 76cce6e1-87db-41a8-b70c-e80a55552f0b on hv-cinder-82880 Sep 13 20:25:15.219490 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-75028e5c-68c6-4e9e-9cc9-3d7fd9d94ef4 req-01401feb-1141-48da-adf6-cad9989f5ef8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173227 Sep 13 20:25:15.220047 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1373/2815] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:25:15.826809 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aa0dcf36-7aec-4965-9e0e-243ff4522a35 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6765331310>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:15.876947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aa0dcf36-7aec-4965-9e0e-243ff4522a35 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 200 len: 344 microversion: 2.1 time: 0.053981 Sep 13 20:25:15.877598 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1443/2816] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:15 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:16.161353 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:16.161998 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:16.168098 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:16.168599 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:16.169031 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:16.169734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:16.170175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:16.170587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:16.174764 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:16.301797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:16.309338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-b13bcda5-504e-45a7-bdae-da8c88b89cef tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.152716 Sep 13 20:25:16.309927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1374/2817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:16 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:16.892138 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-582a8149-ec31-4a7e-b7ac-d03d44089de4 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f6764fa8820>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:16.938938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-582a8149-ec31-4a7e-b7ac-d03d44089de4 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 200 len: 344 microversion: 2.1 time: 0.051043 Sep 13 20:25:16.939494 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1444/2818] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:16 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:17.332746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:17.333311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:17.340161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:17.340635 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:17.341068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:17.341773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:17.342224 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:17.342646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:17.470864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:17.478858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-75529aa0-877a-4a4b-8a64-668afbdb6fd1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.150104 Sep 13 20:25:17.479431 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1375/2819] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:17 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:17.954133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d62d5a05-9685-42bd-9428-63c7b95f7da0 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67651cf1f0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:18.002716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d62d5a05-9685-42bd-9428-63c7b95f7da0 tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 200 len: 344 microversion: 2.1 time: 0.053471 Sep 13 20:25:18.003282 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1445/2820] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:17 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:18.502460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:18.503097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:18.509097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:18.509573 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:18.510034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:18.510751 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:18.511201 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:18.511620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:18.641674 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:18.649264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-69ec15ba-96b9-454d-9086-b4d2f5456be4 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1367 microversion: 2.1 time: 0.150768 Sep 13 20:25:18.649876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1376/2821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:18 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:19.017758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a78959b-02f8-4f14-82ae-152f8488e2be tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67650801f0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:19.046650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-0a78959b-02f8-4f14-82ae-152f8488e2be tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] HTTP exception thrown: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a78959b-02f8-4f14-82ae-152f8488e2be tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Request method failure captured: Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 HTTP/1.1 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIOcjTpQQMpXwZG2Be0LRdL1xBgB0teTq9fz6FsEXqfJEYCUmmK_8zWTmOrQLJ3g1CYfy2--uSeolHUO-kOhOgZU9G3r_-xJJOCIUCElvxFZONWqntgsnsKG9nk83wiWWba95DDw84_IxhoC6tGkWKID5EqQUdtg6173QgSlNYoMqPO0 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:25:19.048813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f02786494b4a1a901c0d6240921180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 17d37e2bf6324ee88f9f70da52cc63f4 Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '244451a3-2fa2-447f-ad27-d0da78e1df47'} Sep 13 20:25:19.050663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. (HTTP 404) (Request-ID: req-d0171a21-846d-4e80-891a-1a432c3db9ed) Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.051938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:25:19.053549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 20:25:19.055409 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0a78959b-02f8-4f14-82ae-152f8488e2be tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Returning 404 to user: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0a78959b-02f8-4f14-82ae-152f8488e2be tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 404 len: 109 microversion: 2.1 time: 0.036901 Sep 13 20:25:19.057005 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1446/2822] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:19 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:25:19.063804 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-91f7d4da-6944-4283-b4e5-c763806f7bbb tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f676553a0d0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:19.096800 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-91f7d4da-6944-4283-b4e5-c763806f7bbb tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] HTTP exception thrown: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-91f7d4da-6944-4283-b4e5-c763806f7bbb tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Request method failure captured: Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 HTTP/1.1 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIOcjTpQQMpXwZG2Be0LRdL1xBgB0teTq9fz6FsEXqfJEYCUmmK_8zWTmOrQLJ3g1CYfy2--uSeolHUO-kOhOgZU9G3r_-xJJOCIUCElvxFZONWqntgsnsKG9nk83wiWWba95DDw84_IxhoC6tGkWKID5EqQUdtg6173QgSlNYoMqPO0 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:25:19.098958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f02786494b4a1a901c0d6240921180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 17d37e2bf6324ee88f9f70da52cc63f4 Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '244451a3-2fa2-447f-ad27-d0da78e1df47'} Sep 13 20:25:19.100713 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. (HTTP 404) (Request-ID: req-d764c6b5-1f30-4cdb-9073-20395d9f9d0e) Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.101822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:25:19.103979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 20:25:19.107488 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-91f7d4da-6944-4283-b4e5-c763806f7bbb tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Returning 404 to user: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:19.112578 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-91f7d4da-6944-4283-b4e5-c763806f7bbb tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 404 len: 109 microversion: 2.1 time: 0.042151 Sep 13 20:25:19.114681 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1377/2823] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 20:25:19 2022] DELETE /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:25:19.115008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cd48b7cc-dd0c-47b4-815a-7c4e9449672e tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Calling method '.version_select at 0x7f67651e10d0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:19.154816 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-cd48b7cc-dd0c-47b4-815a-7c4e9449672e tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] HTTP exception thrown: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cd48b7cc-dd0c-47b4-815a-7c4e9449672e tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Request method failure captured: Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 HTTP/1.1 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIOcjTpQQMpXwZG2Be0LRdL1xBgB0teTq9fz6FsEXqfJEYCUmmK_8zWTmOrQLJ3g1CYfy2--uSeolHUO-kOhOgZU9G3r_-xJJOCIUCElvxFZONWqntgsnsKG9nk83wiWWba95DDw84_IxhoC6tGkWKID5EqQUdtg6173QgSlNYoMqPO0 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:25:19.157411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8f02786494b4a1a901c0d6240921180"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8f02786494b4a1a901c0d6240921180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: c8f02786494b4a1a901c0d6240921180 Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1769119505 Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 17d37e2bf6324ee88f9f70da52cc63f4 Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1769119505-project Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '244451a3-2fa2-447f-ad27-d0da78e1df47'} Sep 13 20:25:19.159009 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. (HTTP 404) (Request-ID: req-7db31f2c-b3e9-42e5-860a-5ff4c6ba2174) Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.159971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:25:19.161518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 20:25:19.164901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cd48b7cc-dd0c-47b4-815a-7c4e9449672e tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] Returning 404 to user: Volume 244451a3-2fa2-447f-ad27-d0da78e1df47 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cd48b7cc-dd0c-47b4-815a-7c4e9449672e tempest-VolumesSnapshotsTestJSON-1769119505 tempest-VolumesSnapshotsTestJSON-1769119505-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47" status: 404 len: 109 microversion: 2.1 time: 0.057552 Sep 13 20:25:19.167762 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1447/2824] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:19 2022] GET /compute/v2.1/os-volumes/244451a3-2fa2-447f-ad27-d0da78e1df47 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:25:19.672807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:19.673430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:19.680454 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:19.680937 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:19.681370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:19.682086 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:19.682534 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:19.683456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:19.914807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:25:19.922961 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0d95a2df-aab4-40a1-9924-287a0997aed3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1556 microversion: 2.1 time: 0.254492 Sep 13 20:25:19.923604 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1378/2825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:25:19 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1556 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:19.945826 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:19.946401 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:19.952348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:19.952963 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:19.953462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:19.954228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:19.954739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:19.955229 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:20.034855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e807e0ec-8456-4fad-9a55-7f81bec75e9f tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092940 Sep 13 20:25:20.035778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1448/2826] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Sep 13 20:25:19 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:21.539159 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-2373c534-c2a7-4a08-badc-3128375f2581 req-b2bfcd3e-61b8-499e-bf9b-2e58de0608d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76cce6e1-87db-41a8-b70c-e80a55552f0b", "tag": "edf2b37f-8c10-44cd-a612-ebe19912eb38"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:21.556614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2373c534-c2a7-4a08-badc-3128375f2581 req-b2bfcd3e-61b8-499e-bf9b-2e58de0608d0 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:21.559817 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2373c534-c2a7-4a08-badc-3128375f2581 req-b2bfcd3e-61b8-499e-bf9b-2e58de0608d0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:21.560660 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2373c534-c2a7-4a08-badc-3128375f2581 req-b2bfcd3e-61b8-499e-bf9b-2e58de0608d0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:21.591258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-2373c534-c2a7-4a08-badc-3128375f2581 req-b2bfcd3e-61b8-499e-bf9b-2e58de0608d0 service nova] Creating event network-changed:edf2b37f-8c10-44cd-a612-ebe19912eb38 for instance 76cce6e1-87db-41a8-b70c-e80a55552f0b on hv-cinder-82880 Sep 13 20:25:21.605004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-2373c534-c2a7-4a08-badc-3128375f2581 req-b2bfcd3e-61b8-499e-bf9b-2e58de0608d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.403691 Sep 13 20:25:21.606016 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1379/2827] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:22.652272 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4810dd70-4da7-4206-99ea-de54bb1d9d9b tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f6765080160>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:22.700574 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4810dd70-4da7-4206-99ea-de54bb1d9d9b tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/efceb425-96c0-4189-bf29-c507458753b0" status: 200 len: 350 microversion: 2.1 time: 0.052568 Sep 13 20:25:22.701170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1449/2828] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:22 2022] GET /compute/v2.1/os-volumes/efceb425-96c0-4189-bf29-c507458753b0 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:24.083646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-27697c91-b921-49dd-b0d5-d12b128496db tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f676507eee0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:24.138618 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-27697c91-b921-49dd-b0d5-d12b128496db tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/abd8d754-277f-4447-8eaa-a53d34fed878" status: 200 len: 350 microversion: 2.1 time: 0.059168 Sep 13 20:25:24.139198 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1380/2829] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:24 2022] GET /compute/v2.1/os-volumes/abd8d754-277f-4447-8eaa-a53d34fed878 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:25.507797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-691dacf5-4924-4abe-86c9-c688b423d877 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f6764fb4b80>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:25.556259 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-691dacf5-4924-4abe-86c9-c688b423d877 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/587b622e-1481-434d-b9fc-16950fcc11df" status: 200 len: 350 microversion: 2.1 time: 0.052789 Sep 13 20:25:25.556829 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1450/2830] 10.222.0.23 () {58 vars in 1245 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/os-volumes/587b622e-1481-434d-b9fc-16950fcc11df => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:25.570136 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eaad84f9-3ded-4731-b227-acf94dc0d516 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f676502bee0>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:25.655527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eaad84f9-3ded-4731-b227-acf94dc0d516 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089514 Sep 13 20:25:25.656325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1381/2831] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:25.671498 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-574f5bb2-3fd4-4ae6-ad45-c57f87b999cf tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f6765107280>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:25.764945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-574f5bb2-3fd4-4ae6-ad45-c57f87b999cf tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.098309 Sep 13 20:25:25.765543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1451/2832] 10.222.0.23 () {58 vars in 1149 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:25.779687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ffeb9e48-9ce8-430a-9f3c-2801814a1ace tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f67653de940>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:25.872231 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ffeb9e48-9ce8-430a-9f3c-2801814a1ace tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.096854 Sep 13 20:25:25.872806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1382/2833] 10.222.0.23 () {58 vars in 1134 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:25.886628 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c2a1d718-1092-4ff3-a63b-72cdd92d2e80 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f6765107af0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:25.980387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c2a1d718-1092-4ff3-a63b-72cdd92d2e80 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098134 Sep 13 20:25:25.981112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1452/2834] 10.222.0.23 () {58 vars in 1167 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:25:25.994658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2d3efcc5-3a20-4163-9975-9ccd0d16da3f tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f67652dae50>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:26.078832 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2d3efcc5-3a20-4163-9975-9ccd0d16da3f tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088085 Sep 13 20:25:26.079404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1383/2835] 10.222.0.23 () {58 vars in 1170 bytes} [Tue Sep 13 20:25:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:26.093400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b2a245a4-ca68-4ff3-a28f-c7d87a30a1bc tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f67650801f0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:26.175559 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b2a245a4-ca68-4ff3-a28f-c7d87a30a1bc tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086422 Sep 13 20:25:26.176123 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1453/2836] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Sep 13 20:25:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:26.190165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-79e91e9d-b11d-4214-95a7-e4c99714689b tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f67650b4160>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:26.273541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-79e91e9d-b11d-4214-95a7-e4c99714689b tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087224 Sep 13 20:25:26.274129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1384/2837] 10.222.0.23 () {58 vars in 1188 bytes} [Tue Sep 13 20:25:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:26.293407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5a80341f-ea32-4d67-aecf-cc8ee80bd229 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] Calling method '.version_select at 0x7f6765331f70>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:26.384055 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5a80341f-ea32-4d67-aecf-cc8ee80bd229 tempest-VolumesTestJSON-1253933298 tempest-VolumesTestJSON-1253933298-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.098719 Sep 13 20:25:26.384636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1454/2838] 10.222.0.23 () {58 vars in 1155 bytes} [Tue Sep 13 20:25:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:25:57.987019 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:57.987785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=24 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:57.988972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:25:57.989152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:25:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/ips (ip 10.222.0.23) !!! Sep 13 20:25:57.994600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:25:57.995192 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:58.007831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:58.008355 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:58.008785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:58.009469 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:58.009977 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:58.010527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:58.038982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c015805e-8a22-4515-a0ae-8e9b8d0917da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/ips" status: 200 len: 149 microversion: 2.1 time: 0.053770 Sep 13 20:25:58.039553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1385/2839] 10.222.0.23 () {58 vars in 1248 bytes} [Tue Sep 13 20:25:57 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:25:59.381882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:59.382691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=20 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:25:59.386924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c3a764d-ed45-4862-8855-1bb9641e2eaa"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:25:59.389760 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:25:59.396835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:59.397311 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:59.397773 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:59.398453 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:25:59.398896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:25:59.399315 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:25:59.659084 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-db581e35-c9cf-4baa-b2c4-4a869359233a tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "POST /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278280 Sep 13 20:25:59.665060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1455/2840] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 20:25:59 2022] POST /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:08.374933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:08.375437 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:08.378214 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=4 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:08.378838 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:26:08.384354 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:08.384819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:08.385243 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:08.385940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:08.386382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:08.386807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:08.466518 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lazy-loading 'services' on Instance uuid 76cce6e1-87db-41a8-b70c-e80a55552f0b {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:26:08.536990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63d60f3c-dd4d-4ba6-a39f-1df7f5b2b10e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments/5c3a764d-ed45-4862-8855-1bb9641e2eaa" status: 202 len: 0 microversion: 2.1 time: 0.165787 Sep 13 20:26:08.537563 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1386/2841] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:26:08 2022] DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments/5c3a764d-ed45-4862-8855-1bb9641e2eaa => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:26:08.547069 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:08.549313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:08.555534 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:08.556015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:08.556458 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:08.557140 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:08.557592 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:08.558041 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:08.589036 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1ddfc9cb-f310-4701-a7fd-fc810d6480c0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Sep 13 20:26:08.589582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1456/2842] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:08 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:09.603191 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:09.605525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:09.612255 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:09.612739 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:09.613176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:09.613889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:09.614340 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:09.614788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:09.644912 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ead68640-4ed2-4706-b992-ea5a0418ce93 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Sep 13 20:26:09.645463 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1387/2843] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:09 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:10.657491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:10.659713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:10.666354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:10.666827 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:10.667320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:10.667990 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:10.668495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:10.668910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:10.697972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-f662e976-a7db-4b12-bf19-4562198633d3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Sep 13 20:26:10.698513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1457/2844] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:10 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:11.710306 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:11.712467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:11.719012 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:11.719526 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:11.719957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:11.720625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:11.721100 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:11.721519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:11.752787 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d2d39bac-2856-42ad-a2c8-2ab1c2f9db69 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046320 Sep 13 20:26:11.753734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1388/2845] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:11 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:12.765742 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:12.767858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:12.774343 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:12.774818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:12.775252 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:12.775921 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:12.776363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:12.776778 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:12.805313 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-b8f8aaf1-9575-4020-8afc-c6ded8d89eea tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Sep 13 20:26:12.805871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1458/2846] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:12 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:13.817777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:13.819846 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:13.826135 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:13.826609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:13.827036 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:13.828202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:13.828656 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:13.829068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:13.858897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-23e71359-8168-46d0-bd24-906e8faf0ec5 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Sep 13 20:26:13.859455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1389/2847] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:13 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:14.871217 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:14.873325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:14.879619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:14.880087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:14.880518 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:14.881186 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:14.881644 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:14.882064 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:14.910352 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d9c46b0e-ac81-4094-8548-1a15c962be4d tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043364 Sep 13 20:26:14.910894 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1459/2848] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:26:14 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:26:14.974532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:14.975112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:14.982004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:14.982004 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:14.982281 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:14.982959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:14.983402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:14.983816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:15.010416 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:26:15.097705 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f27e5bf8-5613-47ed-a635-57ad6e6cc879 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 204 len: 0 microversion: 2.1 time: 0.126689 Sep 13 20:26:15.098420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1390/2849] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:26:14 2022] DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:26:15.106964 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:15.107575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:15.113487 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:15.114028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:15.114462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:15.115142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:15.115587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:15.116007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:15.418291 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:15.426008 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-aa8ec0a7-bf1d-468b-a8b7-f5351b048b12 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1681 microversion: 2.1 time: 0.323148 Sep 13 20:26:15.426573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1460/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:15 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:26:16.449958 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:16.450658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:16.456987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:16.457464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:16.457933 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:16.458615 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:16.459063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:16.459492 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:16.590470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:16.600520 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-34c2afaa-0685-42f7-94e6-e8bf1ee196c6 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1681 microversion: 2.1 time: 0.154694 Sep 13 20:26:16.601097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1391/2851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:16 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:17.623851 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:17.625045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:17.631654 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:17.632127 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:17.632567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:17.633239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:17.633709 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:17.634131 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:17.761707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:17.769393 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-3d8e1896-dbfb-4d86-a311-21ed7d4f1af0 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1681 microversion: 2.1 time: 0.149467 Sep 13 20:26:17.769985 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1461/2852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:17 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:18.792157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:18.792771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:18.799556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:18.799973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:18.800471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:18.801077 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:18.801528 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:18.801975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:19.191286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:19.198897 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-29bea41e-9dff-4a1a-871a-85e71274cb08 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1681 microversion: 2.1 time: 0.410490 Sep 13 20:26:19.199467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1392/2853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:18 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:20.224247 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:20.224843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:20.231242 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:20.231715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:20.232146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:20.232822 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:20.233266 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:20.233721 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:20.362023 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:20.374160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cb58cc29-c0bd-4c03-a4a1-200be6faf885 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1681 microversion: 2.1 time: 0.149494 Sep 13 20:26:20.374160 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1462/2854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:20 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:21.393935 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:21.395211 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:21.401661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:21.402145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:21.402576 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:21.403258 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:21.403892 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:21.404313 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:21.475765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61b9ae7499154e5eab4f3c23d8bb6785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552017cc73234b8db2ac15a8496e649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:26:21.488687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-68a96169-f44a-4796-b7cd-e6a70ae49dc3 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 200 len: 1614 microversion: 2.1 time: 0.095014 Sep 13 20:26:21.488687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1393/2855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:21 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:26:21.606462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-f54b6b9d-0ee5-4ea6-921e-9f249fb22db8 req-1db9f31c-5991-4623-9344-9b8f839beb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76cce6e1-87db-41a8-b70c-e80a55552f0b", "name": "network-vif-deleted", "tag": "edf2b37f-8c10-44cd-a612-ebe19912eb38"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:26:21.623606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f54b6b9d-0ee5-4ea6-921e-9f249fb22db8 req-1db9f31c-5991-4623-9344-9b8f839beb5c service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:21.624685 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f54b6b9d-0ee5-4ea6-921e-9f249fb22db8 req-1db9f31c-5991-4623-9344-9b8f839beb5c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:21.625207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-f54b6b9d-0ee5-4ea6-921e-9f249fb22db8 req-1db9f31c-5991-4623-9344-9b8f839beb5c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:21.645935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-f54b6b9d-0ee5-4ea6-921e-9f249fb22db8 req-1db9f31c-5991-4623-9344-9b8f839beb5c service nova] Creating event network-vif-deleted:edf2b37f-8c10-44cd-a612-ebe19912eb38 for instance 76cce6e1-87db-41a8-b70c-e80a55552f0b on hv-cinder-82880 Sep 13 20:26:21.651947 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-f54b6b9d-0ee5-4ea6-921e-9f249fb22db8 req-1db9f31c-5991-4623-9344-9b8f839beb5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049243 Sep 13 20:26:21.653938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1463/2856] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:26:22.512866 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:22.513480 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:22.520677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:22.521161 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:22.521592 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:22.522325 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:22.522749 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:22.523172 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:22.538034 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b HTTP/1.1 Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:26:22.539709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:22.541734 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '76cce6e1-87db-41a8-b70c-e80a55552f0b'} Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:22.542700 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:22.544596 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:22.546362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:22.546362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-2f8ba309-98ae-494a-93ac-d2f761c1a469 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 404 len: 111 microversion: 2.1 time: 0.032284 Sep 13 20:26:22.546362 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1394/2857] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:22 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:22.552740 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-e8e2dabb-0b29-4efa-90ac-a50ad1b715ec tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '.version_select at 0x7f67651071f0>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:22.574702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-e8e2dabb-0b29-4efa-90ac-a50ad1b715ec tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093985672" status: 202 len: 0 microversion: 2.1 time: 0.026114 Sep 13 20:26:22.575575 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1464/2858] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Sep 13 20:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093985672 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:26:24.406733 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:24.407348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:24.413587 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:24.414101 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:24.414536 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:24.415215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:24.415663 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:24.416088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:24.431850 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b HTTP/1.1 Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:26:24.433388 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.435230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '76cce6e1-87db-41a8-b70c-e80a55552f0b'} Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:24.436307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.438079 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.439803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:24.439803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a6d9d025-72b4-425e-b28c-e0d298eaed0b tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 404 len: 111 microversion: 2.1 time: 0.032384 Sep 13 20:26:24.439803 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1395/2859] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:26:24 2022] DELETE /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:24.444673 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:24.445394 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 76cce6e1-87db-41a8-b70c-e80a55552f0b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:24.452145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:24.452665 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:24.453152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:24.453860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:24.454301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:24.454716 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:24.467663 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b HTTP/1.1 Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:26:24.470414 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.472144 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '76cce6e1-87db-41a8-b70c-e80a55552f0b'} Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:24.473192 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. Sep 13 20:26:24.475135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:24.476684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance 76cce6e1-87db-41a8-b70c-e80a55552f0b could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:24.476684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-43ad4da0-a371-4658-b108-b6a3ca6be4a1 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b" status: 404 len: 111 microversion: 2.1 time: 0.032713 Sep 13 20:26:24.476684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1465/2860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:24 2022] GET /compute/v2.1/servers/76cce6e1-87db-41a8-b70c-e80a55552f0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:26:25.621477 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:25.622697 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:25.630145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.631001 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.631655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.632400 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.632851 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.633275 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.646753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d HTTP/1.1 Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:26:25.648300 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.650305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'c4d5be8a-859b-4ba2-a738-a9fa561a778d'} Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:25.651347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.654146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.655950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:25.655950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5fdf1a66-d41e-4497-833e-9de8e840548e tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 404 len: 111 microversion: 2.1 time: 0.032592 Sep 13 20:26:25.655950 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1396/2861] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:26:25 2022] DELETE /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:25.658668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:25.659338 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: c4d5be8a-859b-4ba2-a738-a9fa561a778d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:25.665850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.666333 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.666771 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.667479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.667932 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.668354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.683549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d HTTP/1.1 Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:26:25.685057 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.687765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'c4d5be8a-859b-4ba2-a738-a9fa561a778d'} Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:25.688641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. Sep 13 20:26:25.690481 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.692223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance c4d5be8a-859b-4ba2-a738-a9fa561a778d could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:25.692223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-244caf85-201e-4102-b55e-dbae0dc1ff89 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d" status: 404 len: 111 microversion: 2.1 time: 0.032224 Sep 13 20:26:25.692223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1466/2862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:25 2022] GET /compute/v2.1/servers/c4d5be8a-859b-4ba2-a738-a9fa561a778d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:25.696085 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:25.696581 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:25.702735 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.703218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.703659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.704348 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.704797 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.705220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.718810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a HTTP/1.1 Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:26:25.720341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.722268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '85f29b5c-c5ba-4271-b726-112936bae81a'} Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:25.723370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.725068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.726788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:25.726788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-54c0682b-f4ec-4cf5-9a07-bfa753f266da tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 404 len: 111 microversion: 2.1 time: 0.029794 Sep 13 20:26:25.726788 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1397/2863] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:26:25 2022] DELETE /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:25.731629 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:25.732301 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: 85f29b5c-c5ba-4271-b726-112936bae81a] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:25.739482 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.739966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.740399 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.741090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:25.741536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:25.741984 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:25.756341 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a HTTP/1.1 Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:26:25.757898 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.759713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': '85f29b5c-c5ba-4271-b726-112936bae81a'} Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:25.760691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. Sep 13 20:26:25.762380 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:25.763896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance 85f29b5c-c5ba-4271-b726-112936bae81a could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:25.763896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8e06b757-fcea-413d-a7e6-1456706590dc tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a" status: 404 len: 111 microversion: 2.1 time: 0.032038 Sep 13 20:26:25.763896 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1467/2864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:25 2022] GET /compute/v2.1/servers/85f29b5c-c5ba-4271-b726-112936bae81a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:26.908537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:26.909028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:26.915361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:26.915869 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:26.916299 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:26.916973 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:26.917621 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:26.918219 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:26.931645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 HTTP/1.1 Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:26:26.933193 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.934870 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': 'ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0'} Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:26.935741 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.937808 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.939323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:26.939323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1aeb9d28-0030-421b-b617-426ad1c1d506 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 404 len: 111 microversion: 2.1 time: 0.030017 Sep 13 20:26:26.939323 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1398/2865] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:26:26 2022] DELETE /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:26:26.943684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:26:26.944300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] [instance: ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:26:26.950662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:26.951146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:26.951579 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:26.952870 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:26:26.953320 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:26:26.953777 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:26:26.967836 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] HTTP exception thrown: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Request method failure captured: Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 HTTP/1.1 Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN7ALV3l3MHtfuKl3dmdNWbZLwHbIyMq44xT8C8oIxjBpYbx_Q44C1QspHXOinbrZvx5i_VYsxm_ZRmaX7dt2EiiDdmTFl1FLrWw7RdviysxrSj4SX5e-mGcen2QXehMm6m5pVW3n2xXlyK6vxORHcge55hka3GZDwe7Hs4fKn_cATs Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:26:26.969289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/552017cc73234b8db2ac15a8496e649e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_552017cc73234b8db2ac15a8496e649e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 552017cc73234b8db2ac15a8496e649e Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2103089250 Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 61b9ae7499154e5eab4f3c23d8bb6785 Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-AttachVolumeNegativeTest-2103089250-project Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.971000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0'} Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:26:26.975831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. Sep 13 20:26:26.977514 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:26:26.978831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] Returning 404 to user: Instance ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:26:26.978831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-31fbd741-3165-432c-a539-bff8f250e659 tempest-AttachVolumeNegativeTest-2103089250 tempest-AttachVolumeNegativeTest-2103089250-project] 10.222.0.23 "GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0" status: 404 len: 111 microversion: 2.1 time: 0.030861 Sep 13 20:26:26.978831 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1468/2866] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:26:26 2022] GET /compute/v2.1/servers/ed0ab582-d6ee-4139-947f-cf2f0fb5f4d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:27:01.614857 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1721234190", "imageRef": "c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87", "flavorRef": "452"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:01.622320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:01.623166 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:01.677953 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.network.neutron [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] validate_networks() for None {{(pid=127487) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:27:01.943548 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Flavor limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:27:01.943957 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Image limits 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:27:01.944421 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Flavor pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:27:01.944818 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Image pref 0:0:0 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:27:01.945223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.virt.hardware [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:27:01.953916 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:01.954382 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:01.954806 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:01.955541 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:01.955979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:01.956392 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:01.972968 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Getting quotas for project d14ffba2cefc4248bc0fa095c4662601. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:27:01.976929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Getting quotas for user 0b5c1ed6b8e04486b717424df36d1599 and project d14ffba2cefc4248bc0fa095c4662601. Resources: {'ram', 'instances', 'cores'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:27:01.988182 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Going to run 1 instances... {{(pid=127487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:27:01.990428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c92fa4bc-5aff-4ee5-8bb2-ea2acd728a87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:27:02.036909 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a1a9b2dc-98c8-4375-be7b-a9cf0e53f30d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425976 Sep 13 20:27:02.037556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1399/2867] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 20:27:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:27:02.049112 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-318fdf74-2e4a-4a24-b696-7478c6f6ffb6 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:02.049737 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-318fdf74-2e4a-4a24-b696-7478c6f6ffb6 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:02.053197 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:02.053955 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:02.106587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-318fdf74-2e4a-4a24-b696-7478c6f6ffb6 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:02.113919 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-318fdf74-2e4a-4a24-b696-7478c6f6ffb6 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1215 microversion: 2.1 time: 0.069117 Sep 13 20:27:02.114488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1469/2868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:02 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:03.136843 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:03.137450 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:03.144629 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:03.145107 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:03.145537 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:03.146234 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:03.146683 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:03.147105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:03.205738 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:03.213209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-301f2f97-0f20-4272-8fa8-dddac7c7f67a tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1219 microversion: 2.1 time: 0.080677 Sep 13 20:27:03.213793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1400/2869] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:03 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:04.236863 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:04.237492 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:04.244511 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:04.244982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:04.245406 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:04.246178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:04.246619 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:04.247033 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:04.309094 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:04.316588 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-51b0f732-b471-4615-b007-f6736f124118 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1219 microversion: 2.1 time: 0.084186 Sep 13 20:27:04.317145 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1470/2870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:04 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:05.339022 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:05.339564 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:05.346171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:05.346655 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:05.347105 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:05.347784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:05.348229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:05.348647 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:05.409586 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:05.417398 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ad6f161c-9f22-494c-bcbf-b27059956a20 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1267 microversion: 2.1 time: 0.082304 Sep 13 20:27:05.417982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1401/2871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:05 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:06.441175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:06.441821 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:06.448581 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:06.449075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:06.449515 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:06.450236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:06.450690 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:06.451118 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:06.594454 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:06.603031 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-c0cf7e7b-4ed2-483b-ab84-5ed914335eb8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.166486 Sep 13 20:27:06.604327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1471/2872] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:06 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:07.321150 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-ba675a63-50bc-4f49-acce-bbc5417b5b29 req-7dcc48f8-523b-451b-b75f-03d09de93618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1084c8b-3e14-4a05-bd16-0b980d893291", "tag": "859aa1ef-5e9a-4c37-a2b8-17cc1fc210bf"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:07.338163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-ba675a63-50bc-4f49-acce-bbc5417b5b29 req-7dcc48f8-523b-451b-b75f-03d09de93618 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:07.338780 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-ba675a63-50bc-4f49-acce-bbc5417b5b29 req-7dcc48f8-523b-451b-b75f-03d09de93618 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:07.339327 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-ba675a63-50bc-4f49-acce-bbc5417b5b29 req-7dcc48f8-523b-451b-b75f-03d09de93618 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:07.353417 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-ba675a63-50bc-4f49-acce-bbc5417b5b29 req-7dcc48f8-523b-451b-b75f-03d09de93618 service nova] Creating event network-changed:859aa1ef-5e9a-4c37-a2b8-17cc1fc210bf for instance c1084c8b-3e14-4a05-bd16-0b980d893291 on hv-cinder-82880 Sep 13 20:27:07.360124 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-ba675a63-50bc-4f49-acce-bbc5417b5b29 req-7dcc48f8-523b-451b-b75f-03d09de93618 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042666 Sep 13 20:27:07.361006 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1402/2873] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:27:07.627170 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:07.627846 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:07.634128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:07.634610 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:07.635060 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:07.635731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:07.636176 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:07.636595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:07.773956 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:07.781501 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-120c376f-366f-4813-b264-c1b3bbe62f3d tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.158964 Sep 13 20:27:07.782092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1472/2874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:07 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:08.805114 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:08.805829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:08.813276 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:08.813778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:08.814209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:08.814889 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:08.815328 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:08.815740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:08.943068 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:08.950878 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-54b6191b-d82c-48f6-89ae-7cdaca36e2f9 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.149962 Sep 13 20:27:08.951456 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1403/2875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:08 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:09.974244 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:09.974797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:09.981199 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:09.981724 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:09.982165 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:09.982979 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:09.983299 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:09.983720 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:10.107940 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:10.115840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2ede9d38-81d6-4214-8ca5-7dd72f140486 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.145445 Sep 13 20:27:10.116847 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1473/2876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:09 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:11.139319 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:11.139927 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:11.146295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:11.146848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:11.147285 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:11.147966 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:11.148412 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:11.148829 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:11.290369 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:11.298824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d287b72c-ced1-4868-9f44-8461b5ab7d0b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.163133 Sep 13 20:27:11.299420 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1404/2877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:11 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:12.323255 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:12.323860 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:12.326254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:12.331627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:12.332098 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:12.332528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:12.333195 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:12.333657 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:12.334077 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:12.468652 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:12.476327 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-873f0325-606d-40ee-a760-70136be68dd8 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.156917 Sep 13 20:27:12.476882 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1474/2878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:12 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:13.501129 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:13.501815 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:13.505156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:13.505863 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:27:13.510990 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:13.511474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:13.511903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:13.512600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:13.513045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:13.513464 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:13.610218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-75ffc483-3b6c-4250-9faa-e7b59030df9a req-8645b1be-9a5a-47f3-a371-89f0e61e285a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1084c8b-3e14-4a05-bd16-0b980d893291", "name": "network-vif-plugged", "status": "completed", "tag": "859aa1ef-5e9a-4c37-a2b8-17cc1fc210bf"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:13.621361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-75ffc483-3b6c-4250-9faa-e7b59030df9a req-8645b1be-9a5a-47f3-a371-89f0e61e285a service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:13.621941 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-75ffc483-3b6c-4250-9faa-e7b59030df9a req-8645b1be-9a5a-47f3-a371-89f0e61e285a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:13.622474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-75ffc483-3b6c-4250-9faa-e7b59030df9a req-8645b1be-9a5a-47f3-a371-89f0e61e285a service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:13.635226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-75ffc483-3b6c-4250-9faa-e7b59030df9a req-8645b1be-9a5a-47f3-a371-89f0e61e285a service nova] Creating event network-vif-plugged:859aa1ef-5e9a-4c37-a2b8-17cc1fc210bf for instance c1084c8b-3e14-4a05-bd16-0b980d893291 on hv-cinder-82880 Sep 13 20:27:13.640582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-75ffc483-3b6c-4250-9faa-e7b59030df9a req-8645b1be-9a5a-47f3-a371-89f0e61e285a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034576 Sep 13 20:27:13.641428 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1475/2879] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:27:13.653854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:13.662075 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1886ff80-d1eb-474c-ae8d-cd850d0b8034 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.165822 Sep 13 20:27:13.662634 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1405/2880] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:13 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:14.686807 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:14.687493 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:14.693552 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:14.694053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:14.694488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:14.695151 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:14.695590 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:14.696007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:14.825686 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:14.833793 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d87c3b54-18c0-4b31-b9f2-810d7bb5c10b tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1315 microversion: 2.1 time: 0.152262 Sep 13 20:27:14.834345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1476/2881] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:14 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:15.856176 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:15.856767 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:15.863249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:15.863722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:15.864152 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:15.864822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:15.865266 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:15.865706 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:15.993504 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:16.001743 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-eea5dc25-5e9a-4168-8683-39c00000ca5c tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1465 microversion: 2.1 time: 0.149343 Sep 13 20:27:16.002307 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1406/2882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:15 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1465 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:16.048218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:16.048764 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:16.055196 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.055670 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.056095 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.056767 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.057207 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.057635 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.083000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:27:16.159609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1cd163c2-cf03-4686-aad3-2f6dcb162ccb tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 204 len: 0 microversion: 2.1 time: 0.114968 Sep 13 20:27:16.160254 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1477/2883] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:27:16 2022] DELETE /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:27:16.168985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:16.169577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:16.176071 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.176553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.176985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.177688 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:16.178137 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:16.178561 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:16.304876 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:16.313133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d47db0ca-6515-4f96-b5dd-e1457184c924 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1471 microversion: 2.1 time: 0.148470 Sep 13 20:27:16.313709 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1407/2884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:16 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:17.336789 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:17.337508 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:17.344075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:17.344541 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:17.344970 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:17.345662 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:17.346105 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:17.346517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:17.479218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b5c1ed6b8e04486b717424df36d1599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14ffba2cefc4248bc0fa095c4662601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:27:17.487817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-83f891bf-b0be-4f3b-ab1a-85380ce5f120 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 200 len: 1471 microversion: 2.1 time: 0.155239 Sep 13 20:27:17.490053 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1478/2885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:17 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:27:17.908357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-f7da3c7c-5084-4134-b9b0-a47ed678f2fe req-c9ae24e6-9974-4fd9-861c-8cd557385c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1084c8b-3e14-4a05-bd16-0b980d893291", "name": "network-vif-deleted", "tag": "859aa1ef-5e9a-4c37-a2b8-17cc1fc210bf"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:27:17.919757 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f7da3c7c-5084-4134-b9b0-a47ed678f2fe req-c9ae24e6-9974-4fd9-861c-8cd557385c12 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:17.920522 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f7da3c7c-5084-4134-b9b0-a47ed678f2fe req-c9ae24e6-9974-4fd9-861c-8cd557385c12 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:17.920955 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-f7da3c7c-5084-4134-b9b0-a47ed678f2fe req-c9ae24e6-9974-4fd9-861c-8cd557385c12 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:17.934278 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-f7da3c7c-5084-4134-b9b0-a47ed678f2fe req-c9ae24e6-9974-4fd9-861c-8cd557385c12 service nova] Creating event network-vif-deleted:859aa1ef-5e9a-4c37-a2b8-17cc1fc210bf for instance c1084c8b-3e14-4a05-bd16-0b980d893291 on hv-cinder-82880 Sep 13 20:27:17.940467 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-f7da3c7c-5084-4134-b9b0-a47ed678f2fe req-c9ae24e6-9974-4fd9-861c-8cd557385c12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Sep 13 20:27:17.941063 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1408/2886] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:27:18.511945 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:27:18.512622 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] [instance: c1084c8b-3e14-4a05-bd16-0b980d893291] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:27:18.518996 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:18.519478 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:18.519916 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:18.520595 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:27:18.521047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:27:18.521471 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:27:18.535025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] HTTP exception thrown: Instance c1084c8b-3e14-4a05-bd16-0b980d893291 could not be found. Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Request method failure captured: Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 HTTP/1.1 Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIOeUcT7A9JNJBn-xIkMyslN5BvMWS-p9K_L9f5Dk0mzNVj-dx1rqLLiGOgXgy-xxisdLoIwgJCXfRaOG7uDro5q3Zj_09mzduTwJiRJVa6WR8HPVU8KekxTCuuML4j2q9tn6heeTMQRF3PLmWv3pJz4XOKvxgTTyZkczqtYdiTvvlfw Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: d14ffba2cefc4248bc0fa095c4662601 Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-VolumesNegativeTest-533867894 Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:27:18.536627 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d14ffba2cefc4248bc0fa095c4662601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d14ffba2cefc4248bc0fa095c4662601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d14ffba2cefc4248bc0fa095c4662601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d14ffba2cefc4248bc0fa095c4662601"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-VolumesNegativeTest-533867894 Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: d14ffba2cefc4248bc0fa095c4662601 Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-VolumesNegativeTest-533867894 Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-VolumesNegativeTest-533867894-project Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: 0b5c1ed6b8e04486b717424df36d1599 Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-VolumesNegativeTest-533867894-project Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance c1084c8b-3e14-4a05-bd16-0b980d893291 could not be found. Sep 13 20:27:18.538565 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'c1084c8b-3e14-4a05-bd16-0b980d893291'} Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1084c8b-3e14-4a05-bd16-0b980d893291 could not be found. Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:27:18.539577 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1084c8b-3e14-4a05-bd16-0b980d893291 could not be found. Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1084c8b-3e14-4a05-bd16-0b980d893291 could not be found. Sep 13 20:27:18.541114 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:27:18.542517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] Returning 404 to user: Instance c1084c8b-3e14-4a05-bd16-0b980d893291 could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:27:18.542517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a7549de4-d43f-4860-9d1a-5909e8b7a0f1 tempest-VolumesNegativeTest-533867894 tempest-VolumesNegativeTest-533867894-project] 10.222.0.23 "GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291" status: 404 len: 111 microversion: 2.1 time: 0.029982 Sep 13 20:27:18.542517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1479/2887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:27:18 2022] GET /compute/v2.1/servers/c1084c8b-3e14-4a05-bd16-0b980d893291 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:31:01.737175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b4f0d3d3-18f4-492e-a9be-bc7798bc36c8] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 20:31:01.738103 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:31:01.739067 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=48 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:31:01.740076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:31:01.740212 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d (ip 10.222.0.23) !!! Sep 13 20:31:01.741728 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:31:01.741873 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d (ip 10.222.0.23) !!! Sep 13 20:31:01.743602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:31:01.743722 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d (ip 10.222.0.23) !!! Sep 13 20:31:01.748755 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:01.749341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:01.770163 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:01.770641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:01.771080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:01.771771 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:01.772223 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:01.772651 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:01.797320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Going to try to terminate instance {{(pid=127487) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:31:01.871746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-61b1ef93-065b-4b18-b864-42fe7ca7c390 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 204 len: 0 microversion: 2.1 time: 0.136418 Sep 13 20:31:01.872292 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1409/2888] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:31:01 2022] DELETE /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:31:01.879236 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d2a30a1-d0c4-403a-87ad-5de7eb1a61e8] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 20:31:01.880087 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:31:01.880875 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:31:01.881684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:31:01.881850 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d (ip 10.222.0.23) !!! Sep 13 20:31:01.883597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:31:01.883757 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d (ip 10.222.0.23) !!! Sep 13 20:31:01.885125 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 20:31:01.885261 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d (ip 10.222.0.23) !!! Sep 13 20:31:01.889707 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:01.890975 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:01.912237 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:01.912719 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:01.913158 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:01.913877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:01.914334 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:01.914775 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:02.044202 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:31:02.052473 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-48763329-018a-4a28-ba2f-6217cbccf3d3 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1507 microversion: 2.1 time: 0.175253 Sep 13 20:31:02.053028 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1480/2889] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:31:01 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:31:02.775556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] [b4f0d3d3-18f4-492e-a9be-bc7798bc36c8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60524. Sep 13 20:31:02.922221 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-2a301af3-0c0a-4257-bee5-cebf68c0aad0 req-f600b281-c9cd-4be2-800c-1d5b53ec7512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fd1f63a-a05b-4aa2-beea-252f989e8e1d", "name": "network-vif-deleted", "tag": "922e5e0a-e86f-491e-9ec3-b0c98bb11069"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:31:02.939218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2a301af3-0c0a-4257-bee5-cebf68c0aad0 req-f600b281-c9cd-4be2-800c-1d5b53ec7512 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:02.939682 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2a301af3-0c0a-4257-bee5-cebf68c0aad0 req-f600b281-c9cd-4be2-800c-1d5b53ec7512 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:02.940112 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-2a301af3-0c0a-4257-bee5-cebf68c0aad0 req-f600b281-c9cd-4be2-800c-1d5b53ec7512 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:02.950620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-2a301af3-0c0a-4257-bee5-cebf68c0aad0 req-f600b281-c9cd-4be2-800c-1d5b53ec7512 service nova] Creating event network-vif-deleted:922e5e0a-e86f-491e-9ec3-b0c98bb11069 for instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d on hv-cinder-82880 Sep 13 20:31:02.955753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-2a301af3-0c0a-4257-bee5-cebf68c0aad0 req-f600b281-c9cd-4be2-800c-1d5b53ec7512 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198987 Sep 13 20:31:02.956356 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1410/2890] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:31:03.076444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:03.077156 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:03.085078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:03.085582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:03.086155 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:03.086765 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:03.087219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:03.087731 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:03.114550 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d2a30a1-d0c4-403a-87ad-5de7eb1a61e8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60528. Sep 13 20:31:03.128479 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:03.128957 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:03.129412 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:03.129874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'fault' on Instance uuid 1fd1f63a-a05b-4aa2-beea-252f989e8e1d {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:31:03.176019 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:31:03.183848 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-a59c8234-d378-4947-a195-0fef55d6cd8c tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 200 len: 1312 microversion: 2.1 time: 0.111351 Sep 13 20:31:03.184556 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1481/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:31:03 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:31:04.208303 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:04.209020 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: 1fd1f63a-a05b-4aa2-beea-252f989e8e1d] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:04.215553 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:04.216035 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:04.216462 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:04.217127 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:04.217567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:04.218007 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:04.230855 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d could not be found. Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d HTTP/1.1 Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:31:04.232455 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d could not be found. Sep 13 20:31:04.234996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '1fd1f63a-a05b-4aa2-beea-252f989e8e1d'} Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d could not be found. Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:31:04.236260 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d could not be found. Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d could not be found. Sep 13 20:31:04.238147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:31:04.239789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Instance 1fd1f63a-a05b-4aa2-beea-252f989e8e1d could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:31:04.239789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-df15a5ed-cabb-4912-98ad-708b897fa8f0 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d" status: 404 len: 111 microversion: 2.1 time: 0.029976 Sep 13 20:31:04.239789 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1411/2892] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:31:04 2022] GET /compute/v2.1/servers/1fd1f63a-a05b-4aa2-beea-252f989e8e1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:31:04.242988 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:04.243476 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:04.250739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:04.251223 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:04.251668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:04.252368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:04.252813 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:04.253232 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:04.277739 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:31:04.351993 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-33bc0105-25d9-4bab-bb89-73e3e00eac50 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 204 len: 0 microversion: 2.1 time: 0.112558 Sep 13 20:31:04.352586 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1482/2893] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:31:04 2022] DELETE /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 20:31:04.361419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:04.362049 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:04.367861 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:04.368333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:04.368760 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:04.369425 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:04.369898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:04.370311 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:04.547043 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:31:04.554807 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-abd5eb23-fc55-42ca-b2ae-9e8e50fcf9d1 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1522 microversion: 2.1 time: 0.198019 Sep 13 20:31:04.555390 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1412/2894] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:31:04 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:31:05.224897 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-83566a38-cb4e-41b1-a314-d2815ab8ac14 req-f4769725-e8f6-4461-8830-fa9779a88207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfc45d7f-3cb6-47cb-830f-222b9263297b", "name": "network-vif-deleted", "tag": "5b0d8bba-8f0a-47f5-8dcd-eb25e1c65c7f"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:31:05.234251 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-83566a38-cb4e-41b1-a314-d2815ab8ac14 req-f4769725-e8f6-4461-8830-fa9779a88207 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:05.234796 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-83566a38-cb4e-41b1-a314-d2815ab8ac14 req-f4769725-e8f6-4461-8830-fa9779a88207 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:05.235226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-83566a38-cb4e-41b1-a314-d2815ab8ac14 req-f4769725-e8f6-4461-8830-fa9779a88207 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:05.246779 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-83566a38-cb4e-41b1-a314-d2815ab8ac14 req-f4769725-e8f6-4461-8830-fa9779a88207 service nova] Creating event network-vif-deleted:5b0d8bba-8f0a-47f5-8dcd-eb25e1c65c7f for instance dfc45d7f-3cb6-47cb-830f-222b9263297b on hv-cinder-82880 Sep 13 20:31:05.253219 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-83566a38-cb4e-41b1-a314-d2815ab8ac14 req-f4769725-e8f6-4461-8830-fa9779a88207 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032365 Sep 13 20:31:05.253843 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1483/2895] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:31:05.579232 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:05.579979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:05.586982 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:05.587778 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:05.588220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:05.589130 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:05.590218 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:05.590646 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:05.624840 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:05.625445 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:05.626208 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:05.626845 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lazy-loading 'fault' on Instance uuid dfc45d7f-3cb6-47cb-830f-222b9263297b {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:31:05.672831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e295fda2af4157b196c6130aa2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991f30f2c094499b73579677b12abae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:31:05.680603 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1d7962d7-0703-4082-b886-b01c23a4e973 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 200 len: 1312 microversion: 2.1 time: 0.106100 Sep 13 20:31:05.681268 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1413/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:31:05 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:31:06.705782 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:31:06.706488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] [instance: dfc45d7f-3cb6-47cb-830f-222b9263297b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:31:06.712616 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:06.713102 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:06.713540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:06.714246 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:31:06.714694 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:31:06.715117 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:31:06.728858 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.wsgi [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] HTTP exception thrown: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b could not be found. Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Request method failure captured: Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: request: GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b HTTP/1.1 Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept: application/json Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Accept-Encoding: identity Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Connection: close Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Length: 0 Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Content-Type: application/json Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Host: 10.222.0.23 Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Openstack-System-Scope: None Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: User-Agent: python-urllib3/1.26.12 Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Auth-Token: gAAAAABjIN6rt9Y6g_Opfv1I3jJlJ9X1-qHLKgvA0O_j6xH-oT4SbIyRVpXgIn9MJsI3ZF-eo_zpmFVIhzcGye9vM9ZWDJsXr-yUIGVKbt7GY2oOZbcqlB7v1Ywjcu7j4JZcSNFQPUuA2oQiIK0np1LICH9ld5Hl57qrfeaxcE4dfcOtn4jeNz4 Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Id: None Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Domain-Name: None Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Identity-Status: Confirmed Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Is-Admin-Project: True Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Id: default Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Domain-Name: Default Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Role: member,reader Sep 13 20:31:06.730491 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Roles: member,reader Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6991f30f2c094499b73579677b12abae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6991f30f2c094499b73579677b12abae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6991f30f2c094499b73579677b12abae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Id: 6991f30f2c094499b73579677b12abae Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1484516451 Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Id: default Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Domain-Name: Default Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Id: a0e295fda2af4157b196c6130aa2d6d2 Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1484516451-project Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: method: > Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: exception: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b could not be found. Sep 13 20:31:06.732348 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: action_args: {'id': 'dfc45d7f-3cb6-47cb-830f-222b9263297b'} Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b could not be found. Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:31:06.733400 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b could not be found. Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b could not be found. Sep 13 20:31:06.735179 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: ERROR nova.api.openstack.wsgi Sep 13 20:31:06.736999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] Returning 404 to user: Instance dfc45d7f-3cb6-47cb-830f-222b9263297b could not be found. {{(pid=127486) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:31:06.736999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-54b07de1-6fc8-42c0-bbab-2a1177c95e08 tempest-ServerRescueNegativeTestJSON-1484516451 tempest-ServerRescueNegativeTestJSON-1484516451-project] 10.222.0.23 "GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b" status: 404 len: 111 microversion: 2.1 time: 0.031298 Sep 13 20:31:06.736999 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1484/2897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:31:06 2022] GET /compute/v2.1/servers/dfc45d7f-3cb6-47cb-830f-222b9263297b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:32:52.383622 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:32:52.384363 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:32:52.389263 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-24973112-f0a8-4f5a-ac91-2204ac160271 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Action: 'create', calling method: .version_select at 0x7f676507e430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1114389638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5B/usfn+gtLU8BRWkQ96Q1AWGHDJ+9IkIeSAceAVygxphLSuVC5DXgzetL8x5BETiX1uFq7QPQfjp0axTX3TSJ98wLFviqRHg2jW1XRRJ7MWTfxn8sD6JwZ0fiazCWZg=="}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:32:52.407831 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-24973112-f0a8-4f5a-ac91-2204ac160271 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Getting quotas for project d255544711d242ca885e574b9170703b. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:32:52.411527 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.quota [None req-24973112-f0a8-4f5a-ac91-2204ac160271 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Getting quotas for user 6872a9b421bb4c19865b769827bc01ae and project d255544711d242ca885e574b9170703b. Resources: {'key_pairs'} {{(pid=127487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:32:52.437121 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-24973112-f0a8-4f5a-ac91-2204ac160271 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055402 Sep 13 20:32:52.437801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1414/2898] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Sep 13 20:32:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:32:52.489589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:32:52.491429 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:32:52.498549 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-917672649", "imageRef": "5fca8ee1-6ed5-408f-814b-d10fd689ec72", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1114389638", "networks": [{"uuid": "9302b6b7-7149-46c8-bb16-69c29649b0bc"}]}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:32:52.660407 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.network.neutron [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] validate_networks() for [('9302b6b7-7149-46c8-bb16-69c29649b0bc', None, None, None, None, None)] {{(pid=127486) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:32:53.108727 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Flavor limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:32:53.109147 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Image limits 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:32:53.109660 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Flavor pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:32:53.110129 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Image pref 0:0:0 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:32:53.110536 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.virt.hardware [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127486) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:32:53.119959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:53.120430 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:53.120861 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:53.121573 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:53.122052 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:53.122474 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:53.140267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Getting quotas for project d255544711d242ca885e574b9170703b. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:32:53.144226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.quota [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Getting quotas for user 6872a9b421bb4c19865b769827bc01ae and project d255544711d242ca885e574b9170703b. Resources: {'ram', 'instances', 'cores'} {{(pid=127486) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:32:53.154924 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Going to run 1 instances... {{(pid=127486) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:32:53.157110 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5fca8ee1-6ed5-408f-814b-d10fd689ec72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127486) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:32:53.203262 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0936de21-330f-4256-8210-451e54afc19f tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716432 Sep 13 20:32:53.207353 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1485/2899] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Sep 13 20:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:32:53.215273 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0a3fa34-1ac7-4bea-b64f-649f47c547ac tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:32:53.216005 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0a3fa34-1ac7-4bea-b64f-649f47c547ac tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:32:53.268881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a0a3fa34-1ac7-4bea-b64f-649f47c547ac tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:32:53.277402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0a3fa34-1ac7-4bea-b64f-649f47c547ac tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1258 microversion: 2.1 time: 0.066059 Sep 13 20:32:53.278084 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1415/2900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:32:53 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:32:54.302594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:32:54.304070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:32:54.313226 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:54.314116 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:54.314613 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:54.315339 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:54.315971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:54.316422 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:54.384007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:32:54.392347 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-550812c9-2e2b-43f9-b42b-408d926f1ae8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1328 microversion: 2.1 time: 0.095613 Sep 13 20:32:54.393591 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1486/2901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:32:54 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:32:55.416393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:32:55.417623 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:32:55.424816 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:55.425297 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:55.425918 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:55.426773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:55.427361 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:55.427911 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:55.559746 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:32:55.567305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a55bbe51-a443-4394-adc8-5736ec01e243 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.154931 Sep 13 20:32:55.568156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1416/2902] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:32:55 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:32:56.590833 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:32:56.591435 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:32:56.598871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:56.599488 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:56.599978 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:56.600763 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:56.601212 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:56.602152 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:56.740814 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:32:56.750532 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-48bf8d41-6ee8-4dc4-9f9e-7deb3ea8c2f3 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.163445 Sep 13 20:32:56.751128 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1487/2903] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:32:56 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:32:57.772826 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:32:57.773519 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:32:57.779972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:57.780447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:57.780875 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:57.781556 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:57.782023 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:57.782435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:57.924147 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:32:57.933133 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e2544b8c-b1e7-446c-8120-a9f757ebbe6a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.164147 Sep 13 20:32:57.933934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1417/2904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:32:57 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:32:58.960480 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:32:58.961790 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:32:58.968228 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:58.968735 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:58.969175 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:58.969908 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:32:58.970389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:32:58.970855 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:32:59.111871 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:32:59.120462 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0bf26aba-73f4-4093-a2d9-9535c99a79b7 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.163936 Sep 13 20:32:59.121230 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1488/2905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:32:58 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:00.143216 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:00.143979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:00.150836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:00.151402 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:00.151903 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:00.152694 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:00.153162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:00.153693 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:00.304625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:00.313236 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-39680306-1c45-4b39-be09-2fdd628b4364 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.173864 Sep 13 20:33:00.313947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1418/2906] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:00 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:01.336324 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:01.337995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:01.344877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:01.345361 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:01.345828 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:01.346560 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:01.347012 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:01.347513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:01.487345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:01.496443 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-626eb216-3480-49da-bbb5-54326939d5b4 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.163993 Sep 13 20:33:01.497022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1489/2907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:01 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:02.520149 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:02.520844 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:02.528206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:02.528685 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:02.529117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:02.529837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:02.530286 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:02.530701 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:02.667610 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:02.675636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-f2c6fc60-3e01-40df-af78-aa416ecf0d32 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.159478 Sep 13 20:33:02.676593 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1419/2908] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:02 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:03.698927 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:03.699566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:03.701593 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=2 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:03.702300 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell0:SELECT=6 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:03.708874 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:03.709350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:03.709817 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:03.710524 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:03.710968 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:03.711389 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:03.836944 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:03.844512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-9bd47d1d-baf6-473e-89d6-f9340cacc84c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.150070 Sep 13 20:33:03.845067 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1490/2909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:03 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:04.867027 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:04.867636 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:04.869801 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=6 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:04.875298 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:04.875720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:04.876157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:04.876849 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:04.877295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:04.877752 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:04.974420 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-24d71c79-4d12-40e1-a1e1-938f44a8720e req-63149b6f-d8f6-45e4-bf56-565d64a7b3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:05.000332 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-24d71c79-4d12-40e1-a1e1-938f44a8720e req-63149b6f-d8f6-45e4-bf56-565d64a7b3ee service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:05.001841 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-24d71c79-4d12-40e1-a1e1-938f44a8720e req-63149b6f-d8f6-45e4-bf56-565d64a7b3ee service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:05.002509 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-24d71c79-4d12-40e1-a1e1-938f44a8720e req-63149b6f-d8f6-45e4-bf56-565d64a7b3ee service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:05.014900 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-24d71c79-4d12-40e1-a1e1-938f44a8720e req-63149b6f-d8f6-45e4-bf56-565d64a7b3ee service nova] Creating event network-changed:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:33:05.023308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-24d71c79-4d12-40e1-a1e1-938f44a8720e req-63149b6f-d8f6-45e4-bf56-565d64a7b3ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052467 Sep 13 20:33:05.023911 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1491/2910] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:05.034428 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:05.041979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-9154bd78-6286-4b6a-ad4c-69ba39ae2964 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.178992 Sep 13 20:33:05.042550 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1420/2911] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:04 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:06.070141 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:06.070859 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:06.079296 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:06.079795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:06.080239 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:06.080935 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:06.081390 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:06.081849 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:06.213960 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:06.221636 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-4549a8c3-0be0-4662-bf57-4819f5283402 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.160259 Sep 13 20:33:06.222209 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1492/2912] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:06 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:07.244614 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:07.245229 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:07.252183 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:07.253898 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:07.254344 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:07.255396 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:07.255858 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:07.256287 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:07.386525 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:07.394109 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-241c7a10-29e3-4fc1-b82b-74574e341ba8 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.153668 Sep 13 20:33:07.394668 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1421/2913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:07 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:08.417959 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:08.418566 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:08.424856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:08.425325 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:08.425797 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:08.426464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:08.426906 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:08.427321 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:08.555133 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:08.563382 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-358e1444-a5e6-4c6d-a1c8-08a9280a851e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.149333 Sep 13 20:33:08.563961 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1493/2914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:08 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:09.406566 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-9c96e813-10f9-45d4-bee9-fa24b9b869b6 req-fa1ebda7-a3bc-43b2-a699-56253b286036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "name": "network-vif-plugged", "status": "completed", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:09.416254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-9c96e813-10f9-45d4-bee9-fa24b9b869b6 req-fa1ebda7-a3bc-43b2-a699-56253b286036 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:09.416727 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-9c96e813-10f9-45d4-bee9-fa24b9b869b6 req-fa1ebda7-a3bc-43b2-a699-56253b286036 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:09.417156 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-9c96e813-10f9-45d4-bee9-fa24b9b869b6 req-fa1ebda7-a3bc-43b2-a699-56253b286036 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:09.428028 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-9c96e813-10f9-45d4-bee9-fa24b9b869b6 req-fa1ebda7-a3bc-43b2-a699-56253b286036 service nova] Creating event network-vif-plugged:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:33:09.433069 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-9c96e813-10f9-45d4-bee9-fa24b9b869b6 req-fa1ebda7-a3bc-43b2-a699-56253b286036 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096849 Sep 13 20:33:09.433673 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1422/2915] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:09.585966 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:09.586543 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:09.593289 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:09.593804 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:09.594233 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:09.594910 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:09.595528 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:09.595967 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:09.721832 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:09.729335 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1585b414-9c2b-4fb0-90f8-18ed8377649c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1358 microversion: 2.1 time: 0.147507 Sep 13 20:33:09.729928 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1494/2916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:09 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:10.753195 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:10.753922 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:10.759976 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:10.760452 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:10.760882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:10.762088 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:10.762630 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:10.762987 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:10.894894 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:10.903939 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e38e7d75-9e83-4439-8a97-9fe95af161e1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1549 microversion: 2.1 time: 0.155377 Sep 13 20:33:10.908965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1423/2917] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:10 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:10.926392 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:10.927006 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:10.933368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:10.933877 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:10.934314 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:10.934998 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:10.935447 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:10.935872 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:11.068417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:11.076519 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-29dcf6ea-a0d8-4a9a-8dc7-774f41671e16 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1549 microversion: 2.1 time: 0.154006 Sep 13 20:33:11.077075 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1495/2918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:10 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:11.098620 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:11.103512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:11.104264 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Searching by: {'deleted': False, 'project_id': 'd255544711d242ca885e574b9170703b'} {{(pid=127487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 20:33:11.110777 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:11.111248 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:11.111675 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:11.112381 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:11.112822 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:11.113237 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:11.200226 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.multi_cell_list [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 20:33:11.291476 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-63d56be2-a692-488f-8cf3-d4c87c7bfa05 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196468 Sep 13 20:33:11.291969 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1424/2919] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Sep 13 20:33:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:11.303351 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:11.303989 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:11.310446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:11.310917 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:11.311350 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:11.312022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:11.312465 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:11.312886 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:11.443733 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:11.452015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-1427cf02-00c0-4bd3-af5c-4eee1ec36ff2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1549 microversion: 2.1 time: 0.152478 Sep 13 20:33:11.452584 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1496/2920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:11 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:12.985926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15c2f2db-acea-4198-949d-ff1f7732e7b8"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:12.988270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:12.995503 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:12.995975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:12.996397 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:12.997796 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:12.998238 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:12.998658 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:13.235824 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-0d400b78-0834-4c0c-b2ae-ae5f1c031c29 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254228 Sep 13 20:33:13.236475 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1425/2921] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Sep 13 20:33:12 2022] POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:19.759354 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:19.759986 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:19.767395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:19.767795 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:19.768444 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:19.769290 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:19.769994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:19.770525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:19.898387 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:19.913070 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-8f80584b-c8d2-49e1-bc96-892443586f36 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1595 microversion: 2.1 time: 0.157497 Sep 13 20:33:19.913792 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1497/2922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:19 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:21.534641 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell0:SELECT=2 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:21.594310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-693c1d07-494b-4cfe-81aa-37f1ade19e33 req-f244cc3a-1687-464d-8e4f-388558657fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:21.604230 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-693c1d07-494b-4cfe-81aa-37f1ade19e33 req-f244cc3a-1687-464d-8e4f-388558657fb0 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:21.604699 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-693c1d07-494b-4cfe-81aa-37f1ade19e33 req-f244cc3a-1687-464d-8e4f-388558657fb0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:21.605117 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-693c1d07-494b-4cfe-81aa-37f1ade19e33 req-f244cc3a-1687-464d-8e4f-388558657fb0 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:21.617320 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-693c1d07-494b-4cfe-81aa-37f1ade19e33 req-f244cc3a-1687-464d-8e4f-388558657fb0 service nova] Creating event network-changed:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:33:21.623295 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-693c1d07-494b-4cfe-81aa-37f1ade19e33 req-f244cc3a-1687-464d-8e4f-388558657fb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093509 Sep 13 20:33:21.623947 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1426/2923] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:22.549540 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-287547019"}} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:22.550109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:22.552587 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:22.558495 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:22.559007 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:22.559446 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:22.560135 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:22.561162 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:22.561641 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:22.564612 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=71 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:22.691857 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.network.security_group_api [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Adding security group 6e22bc79-a49a-466b-8083-5183e7532721 to port b8aa3228-39c9-482d-b67d-d58ce062b171 Sep 13 20:33:23.006585 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-cf513b67-cfbe-4090-82cd-c1ad2dcac26d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action" status: 202 len: 0 microversion: 2.1 time: 0.461237 Sep 13 20:33:23.007286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1498/2924] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 20:33:22 2022] POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:33:23.025583 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:23.026972 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:23.031559 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:23.035601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:23.036670 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:23.037162 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:23.037900 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:23.038343 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:23.038994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:23.045341 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:23.196158 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:23.204758 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a259c96a-a246-4820-a2f7-ad4e854b2ebc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1760 microversion: 2.1 time: 0.188636 Sep 13 20:33:23.205430 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1427/2925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:23 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:23.639090 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-ddd79a0d-f8a9-4d80-8a32-1b02f800f06c req-68b59272-1d8c-4d62-8a00-ed416d6c0cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:23.648264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-ddd79a0d-f8a9-4d80-8a32-1b02f800f06c req-68b59272-1d8c-4d62-8a00-ed416d6c0cea service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:23.648725 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-ddd79a0d-f8a9-4d80-8a32-1b02f800f06c req-68b59272-1d8c-4d62-8a00-ed416d6c0cea service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:23.649142 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-ddd79a0d-f8a9-4d80-8a32-1b02f800f06c req-68b59272-1d8c-4d62-8a00-ed416d6c0cea service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:23.660530 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-ddd79a0d-f8a9-4d80-8a32-1b02f800f06c req-68b59272-1d8c-4d62-8a00-ed416d6c0cea service nova] Creating event network-changed:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:33:23.665651 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-ddd79a0d-f8a9-4d80-8a32-1b02f800f06c req-68b59272-1d8c-4d62-8a00-ed416d6c0cea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031118 Sep 13 20:33:23.666238 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1499/2926] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:33:45.535965 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:33:45.538225 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:45.540600 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:45.541249 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=5 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:45.546704 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:45.547175 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:45.547605 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:45.548277 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:45.548718 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:45.549134 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:45.621560 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-d505ef97-84ac-4ff6-9310-5003fa8c8a00 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action" status: 202 len: 0 microversion: 2.1 time: 0.089308 Sep 13 20:33:45.622470 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1428/2927] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 20:33:45 2022] POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:33:45.629395 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=3 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:45.630161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=5 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:33:45.634597 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:45.635278 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:45.644078 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:45.644561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:45.644982 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:45.645693 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:45.646137 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:45.646603 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:45.795039 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:45.804025 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-d1042ea2-a242-45ed-9128-baadf0044824 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1752 microversion: 2.1 time: 0.176486 Sep 13 20:33:45.804915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1500/2928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:45 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:46.828308 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:46.829010 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:46.835165 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:46.835642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:46.836076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:46.836753 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:46.837202 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:46.837645 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:46.978940 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:46.986974 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-a0035dab-d2ea-4b7b-b999-a81e372dc077 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.163311 Sep 13 20:33:46.988050 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1429/2929] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:46 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:48.011915 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:48.012517 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:48.019535 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:48.020015 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:48.020445 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:48.021115 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:48.021557 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:48.021994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:48.165464 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:48.173729 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-331140f2-6bba-400b-a9a7-eddfc224bbbc tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.165744 Sep 13 20:33:48.174286 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1501/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:48 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:49.196979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:49.197589 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:49.203929 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:49.204404 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:49.204837 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:49.205505 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:49.206044 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:49.206466 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:49.343501 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:49.352087 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-5c66b993-25c2-42fc-ba73-398cf891579e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.158911 Sep 13 20:33:49.352652 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1430/2931] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:49 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:50.376972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:50.377582 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:50.384567 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:50.385016 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:50.385450 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:50.386161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:50.386609 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:50.387029 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:50.528076 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:50.536203 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0aba9b86-bca4-46c9-9a51-23feb7957e7a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.163343 Sep 13 20:33:50.536838 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1502/2932] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:50 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:51.559731 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:51.560358 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:51.567405 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:51.567881 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:51.568310 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:51.568985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:51.569435 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:51.569883 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:51.708985 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:51.717042 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ce265191-bb5b-42a6-aad5-2a098b9ba828 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.161206 Sep 13 20:33:51.717601 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1431/2933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:51 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:52.740750 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:52.741275 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:52.747678 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:52.748411 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:52.748840 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:52.749512 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:52.749971 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:52.750384 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:52.892056 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:52.900184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2046931f-2a3d-417f-a2ab-29c54254a5da tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.164037 Sep 13 20:33:52.900748 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1503/2934] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:52 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:53.923318 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:53.923919 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:53.930227 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:53.930695 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:53.931120 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:53.931785 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:53.932220 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:53.932632 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:54.071812 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:54.079979 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-547cb436-d8f7-4726-9ad4-376668a94f94 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.160545 Sep 13 20:33:54.080557 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1432/2935] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:53 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:55.103650 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:55.104264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:55.110626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:55.111101 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:55.111533 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:55.112211 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:55.112661 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:55.113092 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:55.257345 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:55.265477 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-55c88757-bb12-46ce-9b85-f1a19b2416df tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.165685 Sep 13 20:33:55.266074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1504/2936] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:55 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:56.288882 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:56.289427 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:56.295864 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:56.296338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:56.296770 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:56.297444 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:56.297930 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:56.298347 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:56.436820 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:56.445045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-c4b320b1-6a3d-4a31-b12f-94dfbfd69b71 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.160652 Sep 13 20:33:56.445625 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1433/2937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:56 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:57.468368 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:57.468972 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:57.475626 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:57.476096 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:57.476525 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:57.477191 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:57.477657 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:57.478074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:57.616088 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:57.624467 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0f4d629c-95a0-47fb-a068-cfdf00893efb tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.159783 Sep 13 20:33:57.625024 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1505/2938] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:57 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:58.648210 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:58.648810 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:58.655256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:58.655740 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:58.656173 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:58.656854 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:58.657305 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:58.657773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:58.805076 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:58.813080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-79fe15ef-220a-44a8-900e-0561ce3f3f9d tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.169691 Sep 13 20:33:58.813653 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1434/2939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:58 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:33:59.836561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:33:59.837169 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:33:59.843561 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:59.844037 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:59.844470 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:59.845146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:33:59.845589 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:33:59.846045 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:33:59.984267 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:33:59.993022 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-36189190-0d87-4e5b-99ca-3ad81a969276 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.160332 Sep 13 20:33:59.993583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1506/2940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:33:59 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:34:01.016609 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:01.017331 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:01.023798 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:01.024267 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:01.024703 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:01.025367 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:01.025842 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:01.026254 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:01.167687 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:34:01.175773 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-8f9d8a83-19ee-45e1-894c-f7dd978bff2c tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1757 microversion: 2.1 time: 0.163135 Sep 13 20:34:01.176338 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1435/2941] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:34:01 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:34:02.200210 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:02.201026 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:02.207369 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:02.207856 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:02.208308 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:02.208995 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:02.209456 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:02.209901 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:02.350293 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:34:02.358457 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0db597fd-118f-4682-97b3-a13c69a3ae34 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1760 microversion: 2.1 time: 0.163118 Sep 13 20:34:02.359048 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1507/2942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:34:02 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:34:35.222256 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-287547019"}} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:34:35.222821 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:35.224962 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_api:SELECT=16 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:34:35.225648 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG dbcounter [-] [127487] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:34:35.226419 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:34:35.226567 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Tue Sep 13 20:34:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action (ip 10.222.0.23) !!! Sep 13 20:34:35.236460 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:35.236941 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:35.237373 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:35.238080 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:35.238532 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:35.238963 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:35.363203 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.network.security_group_api [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Removing security group 6e22bc79-a49a-466b-8083-5183e7532721 from port b8aa3228-39c9-482d-b67d-d58ce062b171 Sep 13 20:34:35.663097 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-ae0bbc48-25bf-4834-8e5e-200823875525 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action" status: 202 len: 0 microversion: 2.1 time: 0.445511 Sep 13 20:34:35.664792 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1436/2943] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Sep 13 20:34:35 2022] POST /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:34:35.696047 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [req-ee5523c6-323b-4092-9539-dadac44f8d0b req-cfeca336-f2e0-4106-9769-0f2b959f8819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:34:35.710018 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_api:SELECT=16 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:34:35.711472 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG dbcounter [-] [127486] Writing DB stats nova_cell1:SELECT=48 {{(pid=127486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:34:35.713691 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:34:35.714753 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: Tue Sep 13 20:34:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 13 20:34:35.719803 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-ee5523c6-323b-4092-9539-dadac44f8d0b req-cfeca336-f2e0-4106-9769-0f2b959f8819 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:35.720835 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-ee5523c6-323b-4092-9539-dadac44f8d0b req-cfeca336-f2e0-4106-9769-0f2b959f8819 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:35.721639 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [req-ee5523c6-323b-4092-9539-dadac44f8d0b req-cfeca336-f2e0-4106-9769-0f2b959f8819 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:35.751702 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.compute.server_external_events [req-ee5523c6-323b-4092-9539-dadac44f8d0b req-cfeca336-f2e0-4106-9769-0f2b959f8819 service nova] Creating event network-changed:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:34:35.757507 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [req-ee5523c6-323b-4092-9539-dadac44f8d0b req-cfeca336-f2e0-4106-9769-0f2b959f8819 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065689 Sep 13 20:34:35.758631 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1508/2944] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:34:37.017565 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:37.018128 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:37.024315 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:37.024793 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:37.025215 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:37.025926 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:37.026370 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:37.026784 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:37.107160 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.objects.instance [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lazy-loading 'services' on Instance uuid 917b1df6-fc10-47b8-92e9-b25ea15dc86b {{(pid=127487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:34:37.183795 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-e25a828b-6072-4714-b6d9-cab6b2ba86f2 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments/15c2f2db-acea-4198-949d-ff1f7732e7b8" status: 202 len: 0 microversion: 2.1 time: 0.170529 Sep 13 20:34:37.184393 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1437/2945] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:34:37 2022] DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments/15c2f2db-acea-4198-949d-ff1f7732e7b8 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:34:37.193938 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:37.196260 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:37.203146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:37.203640 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:37.204074 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:37.204770 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:37.205218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:37.205668 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:37.249715 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-5b5e90a9-bfdc-4987-941e-07a4c84db506 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060595 Sep 13 20:34:37.250292 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1509/2946] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:34:37 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:34:37.773333 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-99746db8-a10c-4fe1-acf7-06b2310b72a1 req-db7b2b64-b1a1-44f3-9f06-23d4ffdbda6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:34:37.783244 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-99746db8-a10c-4fe1-acf7-06b2310b72a1 req-db7b2b64-b1a1-44f3-9f06-23d4ffdbda6c service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:37.783724 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-99746db8-a10c-4fe1-acf7-06b2310b72a1 req-db7b2b64-b1a1-44f3-9f06-23d4ffdbda6c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:37.784157 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-99746db8-a10c-4fe1-acf7-06b2310b72a1 req-db7b2b64-b1a1-44f3-9f06-23d4ffdbda6c service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:37.795577 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-99746db8-a10c-4fe1-acf7-06b2310b72a1 req-db7b2b64-b1a1-44f3-9f06-23d4ffdbda6c service nova] Creating event network-changed:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:34:37.800471 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-99746db8-a10c-4fe1-acf7-06b2310b72a1 req-db7b2b64-b1a1-44f3-9f06-23d4ffdbda6c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031362 Sep 13 20:34:37.801070 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1438/2947] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:34:38.262363 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:38.264424 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:38.271218 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:38.271701 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:38.272139 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:38.272818 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:38.273264 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:38.273713 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:38.302926 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-2c28dfb2-b8bf-4e94-8f95-3128b1322a3a tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044541 Sep 13 20:34:38.303513 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1510/2948] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Sep 13 20:34:38 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:34:38.316204 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:38.316934 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:38.323179 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:38.323659 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:38.324090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:38.324763 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:38.325206 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:38.325642 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:38.399959 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] HTTP exception thrown: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b is not attached to volume 15c2f2db-acea-4198-949d-ff1f7732e7b8 Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Request method failure captured: Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments/15c2f2db-acea-4198-949d-ff1f7732e7b8 HTTP/1.1 Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIOjlA3n0uD2bPknlXiMAL-SI-w0hMpgYkSCHsAFuPIdzKr5I4dTVmTnd5bLDVhRUpuaKm3M5y7NP5l7jv_E0IBSnQ_WR2T98Y5GlVJbu7zuwWzKyH3eY6W6nXScx5GhBbfb-KVutFLZPXTXcjfR5hwzjnDzGQTdf-vu2QRq_b2dhzDI Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d255544711d242ca885e574b9170703b Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-TestMinimumBasicScenario-148719975 Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:34:38.401602 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d255544711d242ca885e574b9170703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d255544711d242ca885e574b9170703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d255544711d242ca885e574b9170703b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d255544711d242ca885e574b9170703b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-TestMinimumBasicScenario-148719975 Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d255544711d242ca885e574b9170703b Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-148719975 Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-TestMinimumBasicScenario-148719975-project Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 6872a9b421bb4c19865b769827bc01ae Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-TestMinimumBasicScenario-148719975-project Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:34:38.402975 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b is not attached to volume 15c2f2db-acea-4198-949d-ff1f7732e7b8 Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'server_id': '917b1df6-fc10-47b8-92e9-b25ea15dc86b', 'id': '15c2f2db-acea-4198-949d-ff1f7732e7b8'} Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 15c2f2db-acea-4198-949d-ff1f7732e7b8. Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:34:38.403716 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b is not attached to volume 15c2f2db-acea-4198-949d-ff1f7732e7b8 Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b is not attached to volume 15c2f2db-acea-4198-949d-ff1f7732e7b8 Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:38.404720 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Returning 404 to user: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b is not attached to volume 15c2f2db-acea-4198-949d-ff1f7732e7b8 {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:34:38.405514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-4546d0d2-d106-40ea-9083-6b46ba7ce1e6 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments/15c2f2db-acea-4198-949d-ff1f7732e7b8" status: 404 len: 154 microversion: 2.1 time: 0.092619 Sep 13 20:34:38.405514 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1439/2949] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Sep 13 20:34:38 2022] DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b/os-volume_attachments/15c2f2db-acea-4198-949d-ff1f7732e7b8 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:34:39.542364 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:39.542854 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:39.549109 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:39.549583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:39.550046 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:39.550718 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:39.551164 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:39.551583 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:39.575548 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Going to try to terminate instance {{(pid=127486) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:34:39.647994 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-0d3938f1-af0c-4301-be1f-bf50feee1192 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 204 len: 0 microversion: 2.1 time: 0.109266 Sep 13 20:34:39.648562 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1511/2950] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Sep 13 20:34:39 2022] DELETE /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:34:39.657409 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:39.657994 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:39.664357 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:39.664836 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:39.665270 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:39.666008 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:39.666447 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:39.666859 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:39.797848 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.policy [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127487) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:34:39.805474 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-1121100d-51d3-405b-9bcc-155d2da3a43e tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1555 microversion: 2.1 time: 0.152639 Sep 13 20:34:39.806045 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1440/2951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:34:39 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:34:40.829594 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:40.830309 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:40.836708 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:40.837184 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:40.837624 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:40.838319 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:40.838761 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:40.839183 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:40.965215 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:34:40.973432 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-93b1ffbd-4ec6-4e7f-bb97-17247a31dd59 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1555 microversion: 2.1 time: 0.148083 Sep 13 20:34:40.974021 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1512/2952] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:34:40 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:34:41.783171 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [req-8d24981c-576a-47ee-836f-23214c9385df req-572cb94c-b7ab-4b96-a27f-327882a357f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "917b1df6-fc10-47b8-92e9-b25ea15dc86b", "name": "network-vif-deleted", "tag": "b8aa3228-39c9-482d-b67d-d58ce062b171"}]} {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:34:41.799512 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-8d24981c-576a-47ee-836f-23214c9385df req-572cb94c-b7ab-4b96-a27f-327882a357f6 service nova] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:41.800337 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-8d24981c-576a-47ee-836f-23214c9385df req-572cb94c-b7ab-4b96-a27f-327882a357f6 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:41.801083 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [req-8d24981c-576a-47ee-836f-23214c9385df req-572cb94c-b7ab-4b96-a27f-327882a357f6 service nova] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:41.818996 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.compute.server_external_events [req-8d24981c-576a-47ee-836f-23214c9385df req-572cb94c-b7ab-4b96-a27f-327882a357f6 service nova] Creating event network-vif-deleted:b8aa3228-39c9-482d-b67d-d58ce062b171 for instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b on hv-cinder-82880 Sep 13 20:34:41.824055 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [req-8d24981c-576a-47ee-836f-23214c9385df req-572cb94c-b7ab-4b96-a27f-327882a357f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044976 Sep 13 20:34:41.824669 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1441/2953] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Sep 13 20:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:34:41.996221 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:41.996758 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.compute.api [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127486) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:42.003684 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:42.004178 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:42.004606 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:42.005274 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:42.006000 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:42.006417 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:42.038161 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:42.038633 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:42.039058 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG oslo_concurrency.lockutils [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127486) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:42.039500 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.objects.instance [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lazy-loading 'fault' on Instance uuid 917b1df6-fc10-47b8-92e9-b25ea15dc86b {{(pid=127486) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:34:42.084167 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.policy [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6872a9b421bb4c19865b769827bc01ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd255544711d242ca885e574b9170703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127486) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:34:42.092163 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-10aa1594-ef60-4964-9b3c-8da5612b5e8b tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 200 len: 1348 microversion: 2.1 time: 0.099769 Sep 13 20:34:42.092741 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1513/2954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:34:41 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:34:43.115986 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '>' {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:43.116677 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.compute.api [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] [instance: 917b1df6-fc10-47b8-92e9-b25ea15dc86b] Fetching instance by UUID {{(pid=127487) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:34:43.123187 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:43.123661 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:43.124090 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:43.124765 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Acquiring lock "70fac71d-69d4-4346-933d-544b74694cfa" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:34:43.125209 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:34:43.126154 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG oslo_concurrency.lockutils [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Lock "70fac71d-69d4-4346-933d-544b74694cfa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:34:43.139543 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.wsgi [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] HTTP exception thrown: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b could not be found. Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Request method failure captured: Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: request: GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b HTTP/1.1 Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept: application/json Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Accept-Encoding: identity Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Connection: close Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Length: 0 Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Content-Type: application/json Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Host: 10.222.0.23 Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: Openstack-System-Scope: None Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: User-Agent: python-urllib3/1.26.12 Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Auth-Token: gAAAAABjIOjlA3n0uD2bPknlXiMAL-SI-w0hMpgYkSCHsAFuPIdzKr5I4dTVmTnd5bLDVhRUpuaKm3M5y7NP5l7jv_E0IBSnQ_WR2T98Y5GlVJbu7zuwWzKyH3eY6W6nXScx5GhBbfb-KVutFLZPXTXcjfR5hwzjnDzGQTdf-vu2QRq_b2dhzDI Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Id: None Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Domain-Name: None Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Identity-Status: Confirmed Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Is-Admin-Project: True Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Id: default Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Domain-Name: Default Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Id: d255544711d242ca885e574b9170703b Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Project-Name: tempest-TestMinimumBasicScenario-148719975 Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Role: member,reader Sep 13 20:34:43.141177 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Roles: member,reader Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d255544711d242ca885e574b9170703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d255544711d242ca885e574b9170703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d255544711d242ca885e574b9170703b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d255544711d242ca885e574b9170703b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}] Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant: tempest-TestMinimumBasicScenario-148719975 Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Id: d255544711d242ca885e574b9170703b Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-148719975 Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User: tempest-TestMinimumBasicScenario-148719975-project Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Id: default Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Domain-Name: Default Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Id: 6872a9b421bb4c19865b769827bc01ae Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: X-User-Name: tempest-TestMinimumBasicScenario-148719975-project Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: method: > Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: exception: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b could not be found. Sep 13 20:34:43.143146 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: action_args: {'id': '917b1df6-fc10-47b8-92e9-b25ea15dc86b'} Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: {{(pid=127487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b could not be found. Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:34:43.144125 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b could not be found. Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b could not be found. Sep 13 20:34:43.145819 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: ERROR nova.api.openstack.wsgi Sep 13 20:34:43.147145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: DEBUG nova.api.openstack.wsgi [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Returning 404 to user: Instance 917b1df6-fc10-47b8-92e9-b25ea15dc86b could not be found. {{(pid=127487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:34:43.147145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: INFO nova.api.openstack.requestlog [None req-075a4eaa-ea6f-48ea-a13d-b3a81cb354d1 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b" status: 404 len: 111 microversion: 2.1 time: 0.031354 Sep 13 20:34:43.147145 dv-cinder-828805-6-iscsi devstack@n-api.service[127487]: [pid: 127487|app: 0|req: 1442/2955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Sep 13 20:34:43 2022] GET /compute/v2.1/servers/917b1df6-fc10-47b8-92e9-b25ea15dc86b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:34:43.151746 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: DEBUG nova.api.openstack.wsgi [None req-550480c0-b4b9-482f-beb2-7c4e287438a5 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] Calling method '.version_select at 0x7f6765062310>' {{(pid=127486) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:34:43.174146 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: INFO nova.api.openstack.requestlog [None req-550480c0-b4b9-482f-beb2-7c4e287438a5 tempest-TestMinimumBasicScenario-148719975 tempest-TestMinimumBasicScenario-148719975-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1114389638" status: 202 len: 0 microversion: 2.1 time: 0.026136 Sep 13 20:34:43.174749 dv-cinder-828805-6-iscsi devstack@n-api.service[127486]: [pid: 127486|app: 0|req: 1514/2956] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Sep 13 20:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1114389638 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)